-- Logs begin at Wed 2022-06-15 23:41:36 UTC, end at Thu 2022-06-16 00:47:34 UTC. -- Jun 16 00:13:20.366441 dv-cinder-843277-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 00:13:20.373702 dv-cinder-843277-4-smb devstack@keystone.service[86558]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:13:20 2022] *** Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: nodename: dv-cinder-843277-4-smb Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: machine: x86_64 Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: clock source: unix Jun 16 00:13:20.375705 dv-cinder-843277-4-smb devstack@keystone.service[86558]: pcre jit disabled Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: detected number of CPU cores: 4 Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: current working directory: / Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: your processes number limit is 47680 Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: your memory page size is 4096 bytes Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: detected max file descriptor number: 2048 Jun 16 00:13:20.376198 dv-cinder-843277-4-smb devstack@keystone.service[86558]: lock engine: pthread robust mutexes Jun 16 00:13:20.376970 dv-cinder-843277-4-smb devstack@keystone.service[86558]: thunder lock: enabled Jun 16 00:13:20.377157 dv-cinder-843277-4-smb devstack@keystone.service[86558]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 00:13:20.377265 dv-cinder-843277-4-smb devstack@keystone.service[86558]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:13:20.421338 dv-cinder-843277-4-smb devstack@keystone.service[86558]: Python main interpreter initialized at 0x55bb633459c0 Jun 16 00:13:20.421338 dv-cinder-843277-4-smb devstack@keystone.service[86558]: python threads support enabled Jun 16 00:13:20.421338 dv-cinder-843277-4-smb devstack@keystone.service[86558]: your server socket listen backlog is limited to 100 connections Jun 16 00:13:20.421338 dv-cinder-843277-4-smb devstack@keystone.service[86558]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:13:20.421717 dv-cinder-843277-4-smb devstack@keystone.service[86558]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:13:20.421795 dv-cinder-843277-4-smb devstack@keystone.service[86558]: *** Operational MODE: preforking *** Jun 16 00:13:20.422026 dv-cinder-843277-4-smb devstack@keystone.service[86558]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:13:20.422026 dv-cinder-843277-4-smb devstack@keystone.service[86558]: spawned uWSGI master process (pid: 86558) Jun 16 00:13:20.422236 dv-cinder-843277-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 00:13:20.423196 dv-cinder-843277-4-smb devstack@keystone.service[86558]: spawned uWSGI worker 1 (pid: 86570, cores: 1) Jun 16 00:13:20.423196 dv-cinder-843277-4-smb devstack@keystone.service[86558]: spawned uWSGI worker 2 (pid: 86571, cores: 1) Jun 16 00:13:20.423481 dv-cinder-843277-4-smb devstack@keystone.service[86558]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:13:26.020610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:13:26.020610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: from cryptography.utils import int_from_bytes Jun 16 00:13:26.021414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:13:26.021414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: from cryptography.utils import int_from_bytes Jun 16 00:13:26.021414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:13:26.021414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: from cryptography.utils import int_from_bytes Jun 16 00:13:26.021958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:13:26.021958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: from cryptography.utils import int_from_bytes Jun 16 00:13:26.071684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:13:26.071851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:13:26.072465 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:13:26.072607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:13:26.072738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] command line args: [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:13:26.072863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] command line args: [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:13:26.072980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:13:26.073171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:13:26.073249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ================================================================================ {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:13:26.073314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ================================================================================ {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:13:26.073384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] admin_token = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.073447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] admin_token = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.073537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] config_dir = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.073646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] config_dir = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.073732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.073797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.073938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] config_source = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.074034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] config_source = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.074112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] debug = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.074183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] debug = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.074260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.074500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.075726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.075844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.075844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_config_append = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_config_append = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_dir = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_dir = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.076981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_file = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_file = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.077940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.078951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.079096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.079184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.079345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.079424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.079623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.079709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] publish_errors = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] publish_errors = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.080913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] standard_threads = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] standard_threads = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.081896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] use_journal = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] use_journal = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] use_json = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.082956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] use_json = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] use_stderr = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] use_stderr = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] use_syslog = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] use_syslog = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:13:26.083759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.083894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.084971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.085911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.086949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.087070 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.087186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.087380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.087558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.088225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.088339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.088579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.088702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.088827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.088943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.089988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090358 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.090956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.091895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.092953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.093948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.094987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.095949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.096948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.097902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.098963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.099077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.099199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.099324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.099450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.099566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.099948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.100993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.101915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.102947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.103078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.103239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.103508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.103632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.103748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.103863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.104962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.105976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.106928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.107998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.108829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.193793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.193982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194218 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.external = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.external = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.194937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.password = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.password = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] auth.token = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] auth.token = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.195971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.196821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.197551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.197639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.197856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.197944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.198903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.199941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.200969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.201957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.202964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.203980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.204981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.205959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.206928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.207942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.208992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.209928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.210918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.211977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.212146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.212237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.212386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.212507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.213928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.214990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216724 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.216965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.217940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.218996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.219077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.219242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.219494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.219573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.219735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.219991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.220113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.220299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.220416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.220653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.220745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.220995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.221096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.221408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.221492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.221662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.221897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.221978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.222142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.222352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.222436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.222625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.222813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.222895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.223982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.224135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.224242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.224383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.224507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.224878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225127 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.225879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.226888 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.227895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.228075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.228273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.228748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.228850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.228997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.229845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.230835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] role.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.231959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] role.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.232833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] role.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] role.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.233998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.234826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.235979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.236997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.237933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238191 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.238920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.239959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.240929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.241997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.242983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.243144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.243222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.243392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.243471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.243632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.244360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.244485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.244603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.244739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.244900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.244900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.connection = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.245962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.246959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.connection = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.247949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.248892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.249939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.250054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.250170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.250285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:13:26.250400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.250400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.250627 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.250869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.251117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.251361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:13:26.251536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:13:26.280377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.280552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.280787 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.280873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.281040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.281272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.289184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.289700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.317924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.318160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.318333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.318571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.372712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.373004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.422022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.422255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.422343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.422555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.489551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.489764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.489855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.490885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.515950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.516037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.516165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.516249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.516375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.516472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.516585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.527482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.527852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.540172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.540364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.540451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.540615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.540708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.540878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.541797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86570) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:13:26.559066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.559279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:13:26.559621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.559824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.559931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:13:26.560066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:13:26.560301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.560383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.560569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.560665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:13:26.560833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.561009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.561089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.561266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.561523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.561780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.572480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.572771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.573047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.573154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.573333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.573415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.573602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.573881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.581563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.582039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.584892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.585179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.585369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.585453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.585651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.585732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.585928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.586991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.587080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.587259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.587339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.587550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.587644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.587847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.588102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.614379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.614577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.616026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.616195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.616310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.616472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.622106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.622267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.622388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.622541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.622672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.622816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.630096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.630186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.630383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.630464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.635364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.635543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.635641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.635737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.635943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.636842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.637022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.637104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.637283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.637364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.655982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.656134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.656251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.656414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.660858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.660984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.664457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.664665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.664759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.664966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.670342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.670932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.673907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.674579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.677548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.677844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.678961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.679115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.679394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.679676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.700035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.700311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.700573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.700701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.700833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.700990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.701262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.701540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.708624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.709467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.710313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.710593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.711179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.711459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.714469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.714746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.715025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.715251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.715335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.715537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.715618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.715821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.716138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.716418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.728955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.729235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.729523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.729798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.730071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.730276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.730358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.730569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.730651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.730872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.731154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.731436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.731712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.732019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.748515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.750126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.751717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.753440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.755202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.756762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.756867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.758379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.758552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.758828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.759111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.760704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.760983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.761265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.766858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.768512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.768601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.770165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.771758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.772068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.772347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.772616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.773428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.773724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.774016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.774297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.782069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.782353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.782626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.783534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.783823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.784129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.790464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86570) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.791213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.791491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.791953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.792224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.792498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.792579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:13:26.792768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.792854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.793894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86570) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.794820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.795096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.795377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.795649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.795946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.796221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:13:26.832546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb633459c0 pid: 86570 (default app) Jun 16 00:13:26.834580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb633459c0 pid: 86571 (default app) Jun 16 00:13:26.835939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b96fa-f7d7-4925-99be-0e3572f0dbf0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.836248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b96fa-f7d7-4925-99be-0e3572f0dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.836531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b96fa-f7d7-4925-99be-0e3572f0dbf0 None None] PATH_INFO: `/v3` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.840825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:34.531630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.532282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.532596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.537868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:34.543848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.544309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.544445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.614349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: INFO dbcounter [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] Registered counter for database keystone Jun 16 00:13:34.636002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG oslo_db.sqlalchemy.engines [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:13:34.642197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writer thread running {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:13:34.824592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG passlib.handlers.bcrypt [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86570) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:13:34.824928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG passlib.handlers.bcrypt [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86570) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:13:34.879503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:34.881146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:35.006660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 00:13:35.124919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.194715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: INFO dbcounter [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] Registered counter for database keystone Jun 16 00:13:35.216564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG oslo_db.sqlalchemy.engines [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:13:35.222622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writer thread running {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:13:35.343241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf309-ad37-4bf1-afb4-be70a17dc8f3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.347474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.348175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.348465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.348747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.357063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.408522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING keystone.common.rbac_enforcer.enforcer [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:13:35.408816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27340f6c-d432-401b-be32-7d05261d036f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.418193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 16 00:13:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:13:35.424119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.438751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23dcf-bd84-4c00-9e9e-4ff0c6c1356f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.443112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.444240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.444536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.444815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] PATH_INFO: `/v3/projects/d17e5ca3e11d4286858e2160767efdde` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.446299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] RBAC: Authorizing `identity:get_project(project_id=d17e5ca3e11d4286858e2160767efdde)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.496519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:13:35.496858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51004f-94d6-470f-a832-10b44a94d937 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.501428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Thu Jun 16 00:13:35 2022] GET /identity/v3/projects/d17e5ca3e11d4286858e2160767efdde => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:37.615293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2ab4-f6bf-4b1c-aa01-d7b2fda5e3ef None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.615850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2ab4-f6bf-4b1c-aa01-d7b2fda5e3ef None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.615850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2ab4-f6bf-4b1c-aa01-d7b2fda5e3ef None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.620124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:37.625560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.625950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.626122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.644525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:37.646037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:37.654625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 00:13:37.678287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2ab4-f6bf-4b1c-aa01-d7b2fda5e3ef None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.691141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2ab4-f6bf-4b1c-aa01-d7b2fda5e3ef None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.695371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136de8b4-fae3-4780-a804-927039149a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.696037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136de8b4-fae3-4780-a804-927039149a72 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.696328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136de8b4-fae3-4780-a804-927039149a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.696606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136de8b4-fae3-4780-a804-927039149a72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.705148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136de8b4-fae3-4780-a804-927039149a72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.706912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136de8b4-fae3-4780-a804-927039149a72 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.715677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:13:37.720908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.730170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1683f-61e5-464f-8647-dea27028eb33 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.734501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183020-841b-4788-8641-394596a8b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.735364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183020-841b-4788-8641-394596a8b804 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.735652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183020-841b-4788-8641-394596a8b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.735962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183020-841b-4788-8641-394596a8b804 admin admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.737333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91183020-841b-4788-8641-394596a8b804 admin admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.739148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91183020-841b-4788-8641-394596a8b804 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.740732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:39.948063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19632433-2a87-415b-9c6f-637df7dab52b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.948603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19632433-2a87-415b-9c6f-637df7dab52b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.948603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19632433-2a87-415b-9c6f-637df7dab52b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.950194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:39.952506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba468eb-54ee-4db0-b384-96e51d5d3784 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.952894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba468eb-54ee-4db0-b384-96e51d5d3784 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.953078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba468eb-54ee-4db0-b384-96e51d5d3784 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.954425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:39.954639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.954927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.955203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.959413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.959707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.960031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.979840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:39.981080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:39.996556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG passlib.handlers.bcrypt [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86571) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:13:39.996978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG passlib.handlers.bcrypt [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86571) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:13:40.043002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:40.044594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:40.065807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:40.089585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.113238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.143504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:40.165181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.194030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769519a7-f6ba-443b-a115-1eeb03fb0661 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.227447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.228733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.229024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.229308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.240413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:40.252268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:40.253202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:13:40.253990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 8/14] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:40.259088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.266399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be441e7-e603-473b-a3e4-21b9b4fbec11 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.268770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.305003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.305906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.306204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.307548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.339913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.359690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658aa56-7bd1-4757-a7f8-738d009faff9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.379319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.380886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.395138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.395816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.396132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.396422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.397177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.397490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.398898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.411017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 9/15] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:40.417385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.480039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 7/16] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:40.485317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.487977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.519294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcd9e2-701d-4f68-9050-1e65fa24220b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.555036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.555932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.556224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.557025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.558253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.559719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.561560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 10/17] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:40.566623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.581037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.584666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488b45-4f36-48b4-b6cf-ad6f2f0cd5c8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.620052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.620854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.621144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.621431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.639754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.641268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:40.662495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:40.663316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:40.664349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:40.664349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:40.664349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:40.664349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:13:40.664349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 8/18] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:40.664904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c844f-6858-40d6-a62e-7b2f8288491b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.670186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.698656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.699454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.699747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.700073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.701269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.702716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.704363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 11/19] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:40.710335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.726307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.769973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9e29-01e8-499e-ab8b-cb8d20781ddc None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.792795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.808825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.809505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.809796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.810078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.810819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.811130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.812562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806475-c858-4dc3-b642-aba7d622a758 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.814174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb3692-ff23-4472-9bb3-cbc0e43ddeb4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.831108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 9/20] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:40.854405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.855090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.855377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.855654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.856554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.domain.id=default, user.id=725291ff274c49f98fe318d9ba9e0802) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.856874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.858373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93e4f-892d-4284-830f-87bc46f28556 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.866072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 12/21] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/role_assignments?user.id=725291ff274c49f98fe318d9ba9e0802&scope.domain.id=default&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:43.598646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb1e0-6fc4-492a-9b21-9d267039a5f8 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.599682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb1e0-6fc4-492a-9b21-9d267039a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.600175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb1e0-6fc4-492a-9b21-9d267039a5f8 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.602223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 10/22] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:43.610941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2872-ebb7-4ad4-8b07-063d1ebbf046 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.611814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2872-ebb7-4ad4-8b07-063d1ebbf046 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.612321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2872-ebb7-4ad4-8b07-063d1ebbf046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.633459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f42b2872-ebb7-4ad4-8b07-063d1ebbf046 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:43.635005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f42b2872-ebb7-4ad4-8b07-063d1ebbf046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:43.703679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc152-13d7-4985-9996-cbc08ee68cd6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.704299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc152-13d7-4985-9996-cbc08ee68cd6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.704792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc152-13d7-4985-9996-cbc08ee68cd6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.706639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 11/23] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:43.712016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.713199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.714423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.746052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:43.747273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:43.752239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 13/24] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:43.753817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fbdcf-7dea-4f12-9a2b-d01cc31bb862 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.754290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fbdcf-7dea-4f12-9a2b-d01cc31bb862 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.754756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fbdcf-7dea-4f12-9a2b-d01cc31bb862 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.756554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 14/25] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:43.765841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.766357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.766812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.794858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:43.796413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:43.883994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 12/26] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:43.885963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.921823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 15/27] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:43.928362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.935048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.969972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.067901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874191c-5e9a-499c-a95a-cd6d9b508515 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.068081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cce98-fd57-46e0-8ecd-112400c204b3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.108698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.110164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.110737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.111063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4721f2-199b-4ae8-bdd6-9bdf7379104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.111449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.111741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4721f2-199b-4ae8-bdd6-9bdf7379104b None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.112059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4721f2-199b-4ae8-bdd6-9bdf7379104b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.112508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4721f2-199b-4ae8-bdd6-9bdf7379104b None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.113452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4721f2-199b-4ae8-bdd6-9bdf7379104b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.115192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4721f2-199b-4ae8-bdd6-9bdf7379104b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.128019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:44.139504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:44.140371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:13:44.141433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 13/28] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:44.147265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.267070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d7f58-7a40-4b33-a281-21e4e0926037 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.277077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.308635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0e6e-e9b4-424b-aa7b-41071d00a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.309373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0e6e-e9b4-424b-aa7b-41071d00a123 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.309668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0e6e-e9b4-424b-aa7b-41071d00a123 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.309955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0e6e-e9b4-424b-aa7b-41071d00a123 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.310730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea0e6e-e9b4-424b-aa7b-41071d00a123 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.312186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea0e6e-e9b4-424b-aa7b-41071d00a123 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.387885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 16/29] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 00:13:43 2022] POST /identity/v3/roles => generated 219 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:44.389862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7ca6-2a37-45da-ad86-a351c855f348 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.390375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7ca6-2a37-45da-ad86-a351c855f348 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.390867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7ca6-2a37-45da-ad86-a351c855f348 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.392784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 17/30] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:44.394073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7ca6-2a37-45da-ad86-a351c855f348 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.455047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 14/31] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 00:13:44 2022] POST /identity/v3/roles => generated 225 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:44.456752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.457056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.458123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.477202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.496208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:44.500709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:44.570382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7ca6-2a37-45da-ad86-a351c855f348 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.652561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.653162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.653466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.653756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.654546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:44.654871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.656588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.658190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 15/32] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:44.668315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 18/33] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:44.674077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.689276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.797469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9a5e2-5f46-4b8b-a5c9-bf0541179c9c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.800421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.840918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.841827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.842120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.842410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.844182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.845833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.847918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 16/34] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:44.855085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.901534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3821d8-420e-449e-a8dd-4dc1d59f2a1d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.930906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.941450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.942489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.942920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.943336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.955015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.956770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.965239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7125cb-45eb-43de-800d-380e0a0da13b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e62d59c3-50a8-4d71-ba0e-3e93d789fd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:44.976245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:44.977319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:44.978128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:44.978128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:44.978128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:44.978128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:13:44.979935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 19/35] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:44.981582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dca2-dcc9-4c3c-8b66-84ec80cb7097 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.981864 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dca2-dcc9-4c3c-8b66-84ec80cb7097 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.982145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dca2-dcc9-4c3c-8b66-84ec80cb7097 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.983426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 20/36] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:44.988792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.989093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.989382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.011929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:45.014187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.014310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:45.015002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.015294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.015577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.016859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.018356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.020102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 17/37] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:45.021113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.065266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.100128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 21/38] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:45.101436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.209495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4431e32-aaf2-4c48-9016-ca6259421c08 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.219398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.243556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748817b2-33da-461a-a8bb-67ca75ca402b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.246947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e689d-0ec5-4683-8aba-64c22edc41d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.247826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e689d-0ec5-4683-8aba-64c22edc41d4 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.248147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e689d-0ec5-4683-8aba-64c22edc41d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.248437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e689d-0ec5-4683-8aba-64c22edc41d4 None admin] PATH_INFO: `/v3/domains/default/users/725291ff274c49f98fe318d9ba9e0802/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.250430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e689d-0ec5-4683-8aba-64c22edc41d4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=725291ff274c49f98fe318d9ba9e0802, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.251923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e689d-0ec5-4683-8aba-64c22edc41d4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.266959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 22/39] 10.222.0.39 () {58 vars in 1361 bytes} [Thu Jun 16 00:13:45 2022] PUT /identity/v3/domains/default/users/725291ff274c49f98fe318d9ba9e0802/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:45.268278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964675-f42f-426e-8c2a-ac19790341bd None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.268751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964675-f42f-426e-8c2a-ac19790341bd None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.269186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964675-f42f-426e-8c2a-ac19790341bd None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.270646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 23/40] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:45.271547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964675-f42f-426e-8c2a-ac19790341bd None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.283858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.284857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.285148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.285429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.286188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.286503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.288757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0131c-e9b1-439e-9a8f-c51d2e78d322 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.302470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 18/41] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.303796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.304118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.304403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.322719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:45.324375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:45.407092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 19/42] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:45.408951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.409096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964675-f42f-426e-8c2a-ac19790341bd None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.450561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.452653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.453542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.453857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.454128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.455349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.456863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.458703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 24/43] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.459241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.501187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.540148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22276c-addf-4e36-a7c9-57ea92e3555f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.578325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46723b-e060-417c-9441-c8199c37db3c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.578764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.579443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.579736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.580069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.580798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.582249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.612858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 20/44] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/projects => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:45.613792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.626997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94e4b9-4434-49d3-b125-0cb4890a322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.628056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94e4b9-4434-49d3-b125-0cb4890a322e None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.628530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94e4b9-4434-49d3-b125-0cb4890a322e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.628993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94e4b9-4434-49d3-b125-0cb4890a322e None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.630120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94e4b9-4434-49d3-b125-0cb4890a322e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.631925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94e4b9-4434-49d3-b125-0cb4890a322e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.654597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 25/45] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:45.733826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.768447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871f68-e0ce-4afc-b0c2-39a2bd6f17f2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.810267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579191e-3aa7-47a9-9784-749487fda031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.810968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579191e-3aa7-47a9-9784-749487fda031 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.811267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579191e-3aa7-47a9-9784-749487fda031 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.811585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579191e-3aa7-47a9-9784-749487fda031 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.812361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579191e-3aa7-47a9-9784-749487fda031 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.813889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579191e-3aa7-47a9-9784-749487fda031 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.847744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 21/46] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:47.484879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738b0f-dff9-4708-a26a-f4fb7d0ffe17 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.485365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738b0f-dff9-4708-a26a-f4fb7d0ffe17 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.485365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738b0f-dff9-4708-a26a-f4fb7d0ffe17 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.486749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 26/47] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:47.491959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.492347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.492541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.510665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:47.511894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:47.579329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 22/48] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:47.603131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738b0f-dff9-4708-a26a-f4fb7d0ffe17 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.700755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.708680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738b0f-dff9-4708-a26a-f4fb7d0ffe17 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.741962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.742692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.742985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.743269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.754336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:47.762935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:47.763791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:13:47.764924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 27/49] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:47.769918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.825422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.872029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39818583-3cdb-4a76-8b5b-449095fdd3a5 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.908289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.908994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.909289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.909573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.910364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:47.910684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.912170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9624-1e1f-4e63-924d-1e1e4cdfbfc3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.926421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 23/50] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:47.933513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.963448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41ae08-66a4-498b-ad84-cd78ef775081 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.963747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41ae08-66a4-498b-ad84-cd78ef775081 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.964077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41ae08-66a4-498b-ad84-cd78ef775081 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.965468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 24/51] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:47.970509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.970808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.971099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.988433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:47.989654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:48.034251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e36f-6ae2-4add-bea1-dc16c143d37b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.062246 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 25/52] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:48.068130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.069011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.069306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.069593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.070789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.072309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.078063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 28/53] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:48.079148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.085835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.112443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.129443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.180336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f41e-dd2d-47c6-99a4-c0ed63296cfa None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.186413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19654-d876-45ed-a3b2-c96ed04df99a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.214839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.215644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.215971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.216272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.217458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.218902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.219496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.220334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.220726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 26/54] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:48.220828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.220984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.222271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.223796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.225916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 29/55] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:48.226499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.231144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.319308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.326906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad1c06-b135-49fb-b32b-a0d27ae5f954 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.329216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0706-1498-4deb-8a70-7fc0aac9dbd6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.346059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.362697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45a9e8-8b96-4a59-8396-b71edb72c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.363367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a9e8-8b96-4a59-8396-b71edb72c35e None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.363658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a9e8-8b96-4a59-8396-b71edb72c35e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.363982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a9e8-8b96-4a59-8396-b71edb72c35e None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.364701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45a9e8-8b96-4a59-8396-b71edb72c35e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.366030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.366212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45a9e8-8b96-4a59-8396-b71edb72c35e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.366698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.366993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.367282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.368213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.domain.id=default, user.id=725291ff274c49f98fe318d9ba9e0802) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.368485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.370461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83b05d-c72d-4e72-92eb-1a4735decb26 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.379233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 27/56] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/role_assignments?user.id=725291ff274c49f98fe318d9ba9e0802&scope.domain.id=default&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:48.398653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 30/57] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 16 00:13:48 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:50.567557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2feda-2eb9-48be-9687-8ce962baeed8 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.568141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2feda-2eb9-48be-9687-8ce962baeed8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.568141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2feda-2eb9-48be-9687-8ce962baeed8 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.569545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 28/58] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:50.575388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.575781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.575981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.591856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:50.593075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:50.658799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 31/59] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:50.684198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2feda-2eb9-48be-9687-8ce962baeed8 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.783325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2feda-2eb9-48be-9687-8ce962baeed8 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.816995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7172a-a874-47ba-ba46-9200cf9c3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.817841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7172a-a874-47ba-ba46-9200cf9c3251 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.818087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7172a-a874-47ba-ba46-9200cf9c3251 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.818374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7172a-a874-47ba-ba46-9200cf9c3251 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.819567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7172a-a874-47ba-ba46-9200cf9c3251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:50.821062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7172a-a874-47ba-ba46-9200cf9c3251 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:50.822725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 29/60] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:50.828142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.900217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:50.925352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627781e5-dc72-4c29-bbf8-9a58a0aec3d3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.957439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ad52-4b5c-4f03-8e8e-69fce67b7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.958106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ad52-4b5c-4f03-8e8e-69fce67b7a7c None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.958397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ad52-4b5c-4f03-8e8e-69fce67b7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.958680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ad52-4b5c-4f03-8e8e-69fce67b7a7c None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.959397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4ad52-4b5c-4f03-8e8e-69fce67b7a7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:50.960867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4ad52-4b5c-4f03-8e8e-69fce67b7a7c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:50.985460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 32/61] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:50 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:54.120360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325069-1798-4052-a4f4-ec961359b23e None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.121352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325069-1798-4052-a4f4-ec961359b23e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.121844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325069-1798-4052-a4f4-ec961359b23e None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.123747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 30/62] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:54.128790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3252d8b-4bd6-408e-9a47-e6689927be64 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.129229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3252d8b-4bd6-408e-9a47-e6689927be64 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.129399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3252d8b-4bd6-408e-9a47-e6689927be64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.152947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c3252d8b-4bd6-408e-9a47-e6689927be64 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:54.154250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c3252d8b-4bd6-408e-9a47-e6689927be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:54.257242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:54.270595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd112526-4c12-4a56-8887-f6031c4047e7 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.271180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd112526-4c12-4a56-8887-f6031c4047e7 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.271682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd112526-4c12-4a56-8887-f6031c4047e7 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.273292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 31/64] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:54.278751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.279289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.279778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.288056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd112526-4c12-4a56-8887-f6031c4047e7 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.304840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:54.306052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:54.400855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.409190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.421283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:54.467261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.489110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd112526-4c12-4a56-8887-f6031c4047e7 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.526807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.527626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.527942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.528237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.540547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:54.549484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:54.550406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:13:54.551406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 32/66] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:54.560161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.656069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a218d4-d756-46a0-afb3-85e98002df40 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.692470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dc21-f250-4472-9dfc-492efe6925bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.693520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dc21-f250-4472-9dfc-492efe6925bf None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.693974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dc21-f250-4472-9dfc-492efe6925bf None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.694456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dc21-f250-4472-9dfc-492efe6925bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.704561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92eb93-a1bb-49c0-9040-477e9647bb03 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.705475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6dc21-f250-4472-9dfc-492efe6925bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:54.714620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-63a6dc21-f250-4472-9dfc-492efe6925bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:54.716456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:54.718288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:54.719304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:13:54.721456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 35/67] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:54.722969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0399c8-bc16-4f3c-a3e7-1100c28cda99 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.723447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0399c8-bc16-4f3c-a3e7-1100c28cda99 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.723906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0399c8-bc16-4f3c-a3e7-1100c28cda99 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.725370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 36/68] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:54.727025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0399c8-bc16-4f3c-a3e7-1100c28cda99 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.754996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.755823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.756295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.756689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.757602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:54.757984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.759739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4065a-ac06-44ef-8924-18b643657022 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.769235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 33/69] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:54.770591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.770967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.771327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.789722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.791652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:54.793202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:54.849983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0399c8-bc16-4f3c-a3e7-1100c28cda99 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.877734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 34/70] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:54.878845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.892791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.893592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.893905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.894183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.895064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:54.895385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.897008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363f383-0422-4233-8de5-3a7cf6c81eed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.906985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 37/71] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:54.908468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0eaa-c327-472d-b880-a68cd80e1682 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.908770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0eaa-c327-472d-b880-a68cd80e1682 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.909059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b0eaa-c327-472d-b880-a68cd80e1682 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.910311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 38/72] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:54.911134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0eaa-c327-472d-b880-a68cd80e1682 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.987125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.990749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627a9de-0c69-496c-8308-c861cb992c33 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.016029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b0eaa-c327-472d-b880-a68cd80e1682 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.024656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.026427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.026720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.027031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.030360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.044180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.045643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.047368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 35/73] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.052153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.062806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa217ae-9a53-46f4-8866-fbc0ca28bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.063638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa217ae-9a53-46f4-8866-fbc0ca28bd59 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.063965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa217ae-9a53-46f4-8866-fbc0ca28bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.064252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa217ae-9a53-46f4-8866-fbc0ca28bd59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.074542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa217ae-9a53-46f4-8866-fbc0ca28bd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9aa217ae-9a53-46f4-8866-fbc0ca28bd59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:55.082714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:55.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:13:55.084464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 39/74] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:55.085737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08528-3f3b-425d-b91f-26d9646d017a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.086036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08528-3f3b-425d-b91f-26d9646d017a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.086324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08528-3f3b-425d-b91f-26d9646d017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.104845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-11c08528-3f3b-425d-b91f-26d9646d017a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:55.105983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-11c08528-3f3b-425d-b91f-26d9646d017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:55.148773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcf55-f156-4a5d-9e5e-de8abf1ee75a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.172193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 40/75] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:55.181246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0d936-573c-43de-9a85-0645266c916b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.181643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0d936-573c-43de-9a85-0645266c916b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.181982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0d936-573c-43de-9a85-0645266c916b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.187560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 41/76] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:55.187675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.187784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0d936-573c-43de-9a85-0645266c916b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.187855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.187855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.187855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.188255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.189715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.191497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 36/77] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.196499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.224401 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.287111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0d936-573c-43de-9a85-0645266c916b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.288788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.298827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a7a6-727f-4e48-a81a-825ec46344d0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.325138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.325790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.326078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.326357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.332760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.333429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.333719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.334000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.334757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.335065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.336493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134ae4b-5ff2-4081-9288-5518de820316 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.345025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 37/78] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.346235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.346534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.346822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.363418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:55.364579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:55.401481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.402957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.431606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 38/79] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:55.432657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.450558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.511208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 42/80] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:55.512094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.514287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.532847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6df43-d854-4e29-8fb3-8c26106c7f44 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.567281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.568121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.568417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.568702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.569901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.571359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.573578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 39/81] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.573578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.611595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b8159-1ab5-40fb-bcf9-2e6ed63d0677 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.645436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.646009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.646296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.646578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.659747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.675012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da0598-6f14-4975-96b7-fb3aa7b77e93 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.709715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.710590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.710883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.711167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.712405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.713901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.714861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.715556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 40/82] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.716462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.716686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.718408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.815370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ae36-1edf-4746-a66f-22707633b7db None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.815944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 43/83] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:55.820891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.849786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.850589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.851223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.851512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.862322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:55.870214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:55.871057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:55.871806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:13:55.876041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 41/84] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:55.876838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.893253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.920381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc06f-7e3e-4c1a-8d74-bf2068c6fb0c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.921853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.954915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.955764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.956088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.956370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.957567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.959003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.960712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 44/85] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.966607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.979696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867a0bb-468c-4f2c-9a4d-9af9f6f02f87 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.013102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.013777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.014069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.014351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.015078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.016569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.041803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 42/86] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:55 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:56.042633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.074554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216151b6-33c2-4cb2-b96d-3ac75604bea9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.114327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.115003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.115293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.115826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.131194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.164821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.170792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea55e72-e807-4760-9a69-1f7327de8337 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.201589 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.203073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.207345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.208269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.208562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.208851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.210464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.212010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.214032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 43/87] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.220619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.319266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 45/88] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:56.323026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.360670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772920c-3b4a-445b-a880-3d5a6bb1795c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.397167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.397848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.398143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.398475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.399199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.399517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.401073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.406971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.418022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 44/89] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.418973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.425432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.472110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d9ff8-74be-4ae6-871f-74576beb70c8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.520870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.521798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.522100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.522798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.523955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=23a8bb99dc8d4e7092a8bf1a6d09759c) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.524289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.527385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.528983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae05bf-88d6-40ad-9659-a2fff2ce71ca None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.534574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 46/90] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/role_assignments?user.id=23a8bb99dc8d4e7092a8bf1a6d09759c&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.535574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.578016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.578699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.578999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.579350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.580785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=725291ff274c49f98fe318d9ba9e0802) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.581117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.583241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.593292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 45/91] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/role_assignments?user.id=725291ff274c49f98fe318d9ba9e0802&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.594374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.682513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.718421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f961508-8bfd-4e05-9190-ece68c5bfe29 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.740118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3bc1a-12e0-4c2f-a5bc-24ff30ee1298 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.787987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.789335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.790081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.790529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.792247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.794079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.796099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 46/92] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.802610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.817352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.818426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.818546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.818802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.824772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.826395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.828415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 47/93] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.835007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.840567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.941993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb862a1d-f1aa-4442-aa99-a9523628aa28 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.979081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.986309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.987214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.987667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.988124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.998174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56b02-6ad3-405f-b5b9-bd8b2e7d82f1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.074679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.076223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.109215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.109904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.110196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.110483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.111338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] RBAC: Adding query filter params (role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=23a8bb99dc8d4e7092a8bf1a6d09759c) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:57.111668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.113172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.126192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 48/94] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/role_assignments?user.id=23a8bb99dc8d4e7092a8bf1a6d09759c&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:57.192095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 47/95] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:57.198077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.301849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.354384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca770678-33d1-43bc-9384-abcaaf332dc3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.395505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17e2f-6a47-448e-9e53-05f9571ff5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.396402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17e2f-6a47-448e-9e53-05f9571ff5ed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.396692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17e2f-6a47-448e-9e53-05f9571ff5ed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.396974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17e2f-6a47-448e-9e53-05f9571ff5ed None admin] PATH_INFO: `/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.398870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17e2f-6a47-448e-9e53-05f9571ff5ed None admin] RBAC: Authorizing `identity:get_project(project_id=816b423ccafe47e8b2a6131d41d5cf4f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.400385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17e2f-6a47-448e-9e53-05f9571ff5ed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.402206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 49/96] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:57.408310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.457210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.551316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaee8a-7435-4192-a83b-55ca78576cd9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.599287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.599992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.600290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.600629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.601747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=816b423ccafe47e8b2a6131d41d5cf4f, user.id=23a8bb99dc8d4e7092a8bf1a6d09759c) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:57.602071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.604095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b23d4-0ab2-41f5-b7c3-dfa0e1324af5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.615959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 48/97] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/role_assignments?user.id=23a8bb99dc8d4e7092a8bf1a6d09759c&scope.project.id=816b423ccafe47e8b2a6131d41d5cf4f&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:58.900938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede81e-80ca-4efa-a6bc-792092d5cf28 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.901439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede81e-80ca-4efa-a6bc-792092d5cf28 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.901704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede81e-80ca-4efa-a6bc-792092d5cf28 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.903133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 50/98] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:58.908547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.909033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.909184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.928434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:58.929650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:59.021844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 49/99] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:59.066442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede81e-80ca-4efa-a6bc-792092d5cf28 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.209222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede81e-80ca-4efa-a6bc-792092d5cf28 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.259162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c483c0-2631-4aab-96a9-4f792a1ff49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.260430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c483c0-2631-4aab-96a9-4f792a1ff49d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.260926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c483c0-2631-4aab-96a9-4f792a1ff49d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.261406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c483c0-2631-4aab-96a9-4f792a1ff49d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.268601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c483c0-2631-4aab-96a9-4f792a1ff49d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.270306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c483c0-2631-4aab-96a9-4f792a1ff49d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.272200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 51/100] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:59.278729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.327397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.445502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf168fe-6b12-4cc2-9349-9bfd6c83025a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.495374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708edf39-e0bb-49d5-905b-9dd264d85d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.496447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708edf39-e0bb-49d5-905b-9dd264d85d89 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.496943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708edf39-e0bb-49d5-905b-9dd264d85d89 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.497434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708edf39-e0bb-49d5-905b-9dd264d85d89 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.498338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708edf39-e0bb-49d5-905b-9dd264d85d89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.500015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708edf39-e0bb-49d5-905b-9dd264d85d89 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.537447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 50/101] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:13:59 2022] POST /identity/v3/projects => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:59.555414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72516a-bdde-48c1-97ef-faa7b03454f4 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.556083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72516a-bdde-48c1-97ef-faa7b03454f4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.557160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72516a-bdde-48c1-97ef-faa7b03454f4 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.558874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 52/102] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:59.578109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.578740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.579224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.605022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:59.606591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:59.677966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325acf-1cf8-4198-983f-3a9adcd07c11 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.678609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325acf-1cf8-4198-983f-3a9adcd07c11 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.679094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325acf-1cf8-4198-983f-3a9adcd07c11 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.680723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 53/103] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:59.689473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.690132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.690618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.697084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.719903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:59.722764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:59.746466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 51/104] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:59.815471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.830447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.848198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 54/105] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:59.884222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.042325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5201d9-6879-4599-ba84-85bf9048d43d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.104328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.105147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.105609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.106046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.109881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0259fc-8d43-47e9-b331-05efb12cc6c9 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.117591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:00.126125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:00.127194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:00.128147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:00.130234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 52/106] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:00.136555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.163461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.170786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340839a5-2538-4e4a-9747-b8ba556eaf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.172010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340839a5-2538-4e4a-9747-b8ba556eaf82 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.172510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340839a5-2538-4e4a-9747-b8ba556eaf82 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.172989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340839a5-2538-4e4a-9747-b8ba556eaf82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.185580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340839a5-2538-4e4a-9747-b8ba556eaf82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-340839a5-2538-4e4a-9747-b8ba556eaf82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:00.193936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:00.194826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:00.195626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:00.198270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 55/107] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:00.199926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1232-85bb-4926-9cb8-07027bf49050 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.200453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1232-85bb-4926-9cb8-07027bf49050 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.201037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1232-85bb-4926-9cb8-07027bf49050 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.202560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 56/108] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:00.207980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.208577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.209083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.225683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.229517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:00.230964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:00.266810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434959-b745-49ec-bc98-52c8592cf671 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.307519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 57/109] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:00.308703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.312950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.313638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.313931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.314216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.314985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:00.315297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.316775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648abf4b-e292-45cc-8e89-ae9e3396002f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.327543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 53/110] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:00.329413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee71522-90ed-416d-925f-b125489a12cd None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.329710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee71522-90ed-416d-925f-b125489a12cd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.329992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee71522-90ed-416d-925f-b125489a12cd None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.331673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 54/111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:00.336792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee71522-90ed-416d-925f-b125489a12cd None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.429557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e6999-9a1e-4ed4-9ba6-9f38f2e2d436 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.454369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.466928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee71522-90ed-416d-925f-b125489a12cd None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.467745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.468664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.469145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.469639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.470590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:00.471101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.472695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d44b6-8b4a-4443-a429-8f9229a3c4e0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.482400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 58/112] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.483996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.484606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.485083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.499361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.502250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:00.503998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:00.507811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.508282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.508645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.509011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.510998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.512587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.514749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 55/113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.515629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.591967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 59/114] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:00.593258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.639308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825399-18e8-4362-948d-f4a8d5777cf2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.682962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.684209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.684694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.685168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.696648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:00.705903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:00.706768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:00.707527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:00.710072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 56/115] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:00.716638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.718847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e156aa-4139-4c75-bee4-d30b6e907df0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.760307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.767655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.769155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.769522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.770027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] PATH_INFO: `/v3/users/de6f57c4de50490fb546b41df71a90c5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.782183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.791548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] RBAC: Authorizing `identity:get_user(user_id=de6f57c4de50490fb546b41df71a90c5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.793766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.796268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 60/116] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/users/de6f57c4de50490fb546b41df71a90c5 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.800813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.834150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994e754-6abf-4f82-91b3-d1505eedc360 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.894499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.895346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.895907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.896301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.897590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.899429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.902798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 57/117] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.903610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f71a-59eb-48ce-b05c-5db2f262c50c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.974789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.975682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.976172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.976456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.988236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:00.997273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:00.998180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:00.998969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 61/118] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:01.000693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.014409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d53e7-c1b2-4ca4-827b-48f539a954ac None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.036620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.043710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.056252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.057541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.060826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.060826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.060826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:01.060826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.061443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.070330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 58/119] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.076111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.121340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30ca5a-0ae4-46ae-aec1-76690ee6016f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.157531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.158114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.158524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.158812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.177625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809144-5317-4ed6-9a14-7c96f0693174 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.220516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06d827-894a-4886-895f-7e30e87dfd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.222027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06d827-894a-4886-895f-7e30e87dfd80 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.222330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06d827-894a-4886-895f-7e30e87dfd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.222621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06d827-894a-4886-895f-7e30e87dfd80 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/23a8bb99dc8d4e7092a8bf1a6d09759c/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.225479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06d827-894a-4886-895f-7e30e87dfd80 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4da631ff0d4917a300966dfb1985a2, user_id=23a8bb99dc8d4e7092a8bf1a6d09759c, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.227377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06d827-894a-4886-895f-7e30e87dfd80 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.230768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.232274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.251912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 59/120] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:01 2022] PUT /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/23a8bb99dc8d4e7092a8bf1a6d09759c/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:01.251912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040c43-d0b9-4eb7-87f5-87e218ca9f7c None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.251912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040c43-d0b9-4eb7-87f5-87e218ca9f7c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.251912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040c43-d0b9-4eb7-87f5-87e218ca9f7c None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.251912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 60/121] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:01.251912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3040c43-d0b9-4eb7-87f5-87e218ca9f7c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.273486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.337446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.382665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 62/122] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:01.383566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.407349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3040c43-d0b9-4eb7-87f5-87e218ca9f7c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.455972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.456601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.456896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.457183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.457954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:01.458271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.459713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91070f-2374-4460-b237-27f87ae36f3e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.468879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 61/123] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.469940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.470241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.470527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.497173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:01.498728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:01.512736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129dbb-586e-491d-8295-2dcdbedbd0c6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.549845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.557317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.558358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.558652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.558936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.560204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.561857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.568125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 63/124] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.568125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.602296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 62/125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:01.608834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.668860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.698492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a519-272c-4189-9c20-81c09713b336 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.739267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309f5f-4c5d-41d6-ade4-fa083a08a4d2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.745959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.747036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.748066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.748523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.750345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.752435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.754897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 64/126] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.755862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.785803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.786693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.787000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.787286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.788520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.790160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.791723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 63/127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.792553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.843752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.888543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510b483-fe8e-412d-8dcc-bee73eb8a73f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.911694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dbdc1-bf5e-4120-95f4-f5be59fa2d22 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.925380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.935444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.936826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.937199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.937557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.938839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.940954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.943078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 65/128] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.944619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.962274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.964301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.965001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.965687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.979612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:01.988564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:01.989548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:01.990317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:01.992857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 64/129] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:01.994313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.083549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7de6f8-fa8b-4adf-b192-05933c760adc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.127847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.128527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.128829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.129114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.130238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] RBAC: Adding query filter params (role.id=8884187957844cf99f36a34b0ef3ae19, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=de6f57c4de50490fb546b41df71a90c5) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:02.130560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.132073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.132330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae4e5-29a0-4069-a5a5-e5327201680c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.136700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.140687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 66/130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/role_assignments?user.id=de6f57c4de50490fb546b41df71a90c5&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=8884187957844cf99f36a34b0ef3ae19 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.142452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.192741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.193745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.194049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.194339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.196030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.197786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.200184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 65/131] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.201026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.273838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1196-dd61-448f-a282-62744d2cab9a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.274059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.312982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.314290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.314786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.315299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/725291ff274c49f98fe318d9ba9e0802/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.317654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4da631ff0d4917a300966dfb1985a2, user_id=725291ff274c49f98fe318d9ba9e0802, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.319579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.341258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 67/132] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:02 2022] PUT /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/725291ff274c49f98fe318d9ba9e0802/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:02.342718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.375137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49356d5-8555-4b28-b181-7d256b18c645 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.426484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.427480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.427770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.428620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.429440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:02.429763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.432260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9976f-10a9-4d81-9412-dd76b57145f5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.435344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.448658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 66/133] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.450142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88eda0-0eda-462c-bce8-ee4ca0cf688f None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.450442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88eda0-0eda-462c-bce8-ee4ca0cf688f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.450731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88eda0-0eda-462c-bce8-ee4ca0cf688f None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.457873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 67/134] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:02.458792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88eda0-0eda-462c-bce8-ee4ca0cf688f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.517452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedba34-8d9e-480e-becc-9d99f1447907 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.582023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7739d0-a1e0-4da2-a58b-a3ab9032cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.582859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7739d0-a1e0-4da2-a58b-a3ab9032cb34 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.583152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7739d0-a1e0-4da2-a58b-a3ab9032cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.583436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7739d0-a1e0-4da2-a58b-a3ab9032cb34 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/23a8bb99dc8d4e7092a8bf1a6d09759c/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.585823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7739d0-a1e0-4da2-a58b-a3ab9032cb34 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4da631ff0d4917a300966dfb1985a2, user_id=23a8bb99dc8d4e7092a8bf1a6d09759c, role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.587301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7739d0-a1e0-4da2-a58b-a3ab9032cb34 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.603789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 68/135] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:02 2022] PUT /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/23a8bb99dc8d4e7092a8bf1a6d09759c/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:02.605256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.605483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.605774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.627660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:02.628558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.628918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:02.634638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88eda0-0eda-462c-bce8-ee4ca0cf688f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.676652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.678102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.678623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.679118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.680763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.683370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.686004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 68/136] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.691987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.707642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 69/137] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:02.733524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.787533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.816808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e375f-74c5-49c7-9c5e-77b76f90e5cd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.842828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc212e1-2bd5-4cda-a655-aab794e5b0c6 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.858262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.859562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.860111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.860718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] PATH_INFO: `/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.862340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] RBAC: Authorizing `identity:get_project(project_id=816b423ccafe47e8b2a6131d41d5cf4f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.864187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.866294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 69/138] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:02.873261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.880389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.881208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.881500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.881783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.883038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.884653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.891410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 70/139] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.892403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.916459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.017787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a68b4-48cb-40aa-9e00-ebbdedb1baa5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.027033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44420-2dac-4bdc-a0e3-896e3813707c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.060124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16754920-d157-4554-b6ff-cbdb1abfac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.061466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754920-d157-4554-b6ff-cbdb1abfac68 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.062235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754920-d157-4554-b6ff-cbdb1abfac68 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.062804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16754920-d157-4554-b6ff-cbdb1abfac68 None admin] PATH_INFO: `/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f/users/23a8bb99dc8d4e7092a8bf1a6d09759c/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.066281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16754920-d157-4554-b6ff-cbdb1abfac68 None admin] RBAC: Authorizing `identity:create_grant(project_id=816b423ccafe47e8b2a6131d41d5cf4f, user_id=23a8bb99dc8d4e7092a8bf1a6d09759c, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.068016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16754920-d157-4554-b6ff-cbdb1abfac68 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.081316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.094232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 70/140] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:02 2022] PUT /identity/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f/users/23a8bb99dc8d4e7092a8bf1a6d09759c/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:14:03.116405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2b623-450b-40fd-8e33-5d6f8f1cab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.117494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b623-450b-40fd-8e33-5d6f8f1cab13 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.118005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b623-450b-40fd-8e33-5d6f8f1cab13 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.118507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b623-450b-40fd-8e33-5d6f8f1cab13 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.119461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2b623-450b-40fd-8e33-5d6f8f1cab13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.121408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2b623-450b-40fd-8e33-5d6f8f1cab13 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.155302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 71/141] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:02 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:03.985995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042c04-6e5f-45cb-95a8-f2700a35c2f7 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.986497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042c04-6e5f-45cb-95a8-f2700a35c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.986571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4042c04-6e5f-45cb-95a8-f2700a35c2f7 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.988248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 71/142] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:03.993295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.993597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.994420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.016886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:04.018084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:04.102803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:04.141406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042c04-6e5f-45cb-95a8-f2700a35c2f7 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.268856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.279917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4042c04-6e5f-45cb-95a8-f2700a35c2f7 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.326291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.327106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.327392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.327672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.341528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:04.349297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:04.350127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:04.351190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:04.352263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 72/144] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:04.357431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.520978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11685c-6faf-465f-8b66-30653f783ea0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.529007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.575666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.576382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.576673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.576958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.577839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:04.578158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.579567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.592723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 73/145] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:04.597909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.769633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ac6ae-997b-4b7c-9226-87597b756419 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.810622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387505-e8f1-4848-865d-eae28abffc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.811433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387505-e8f1-4848-865d-eae28abffc8f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.811718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387505-e8f1-4848-865d-eae28abffc8f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.812026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387505-e8f1-4848-865d-eae28abffc8f None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.816593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387505-e8f1-4848-865d-eae28abffc8f None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.818052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387505-e8f1-4848-865d-eae28abffc8f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.819697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 73/146] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:04.826040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.970312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d6a58-7755-4a74-b8c5-419642d2b6b6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.006472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.007494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.008038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.008514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.088847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.118030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.119987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.178395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aed1b-2858-4789-8ac5-886b591275e3 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.178898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aed1b-2858-4789-8ac5-886b591275e3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.178970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aed1b-2858-4789-8ac5-886b591275e3 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.183979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 74/147] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:05.189329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.189624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.189909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.226504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 74/148] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:05.232438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:05.233838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.243397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:05.280229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.360351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.372380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 75/149] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:05.394920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4114-7899-49ed-bebd-51a09ba76595 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.420975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.432363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.433572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.434167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.434654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.441645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.443386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.447026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 75/150] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:05.456136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.613674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab7d9-011e-4dc0-a815-882f22ca4cbb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.618244 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49077ebd-1fed-4ca0-813d-373b2841251c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.651679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.652797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.653353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.653831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.655015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=23a8bb99dc8d4e7092a8bf1a6d09759c) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:05.655544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.657287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.659551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.669776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 76/151] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/role_assignments?user.id=23a8bb99dc8d4e7092a8bf1a6d09759c&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:05.682727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.683579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.683898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.684173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.702062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:05.710642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:05.711824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:05.712666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 76/152] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:05.718692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.861429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa16dc9-82b3-4518-a5fe-dfbb13e9450a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.908215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.908825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.909118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.909403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.910173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:05.910489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.911935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682109b-3406-49cb-9f69-84d0f03b6b60 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.924148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 77/153] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:05.930378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.953474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.955249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed6bb-35d3-47fc-b3d7-36e30e1285d4 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.955822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed6bb-35d3-47fc-b3d7-36e30e1285d4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.956162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ed6bb-35d3-47fc-b3d7-36e30e1285d4 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.958316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 78/154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:05.965184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.965488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.965778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.988542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:05.989912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:06.077403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.109305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 79/155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:06.120708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b4de6-95e5-4acd-9b47-c6be8cb565ec None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.154262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.182611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.184080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.184564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.185002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] PATH_INFO: `/v3/users/de6f57c4de50490fb546b41df71a90c5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.188700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] RBAC: Authorizing `identity:get_user(user_id=de6f57c4de50490fb546b41df71a90c5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.190180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.192308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 77/156] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/users/de6f57c4de50490fb546b41df71a90c5 => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.198894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.320956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.349168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0fd1-94fa-4cfa-b2db-a01d38f9260c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.395404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.396318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.396510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d319f-b2f2-4339-8291-589e94376fbd None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.396924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.396924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.398086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.399543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.402745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 78/157] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.408243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.465492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.466252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.466535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.466812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.492921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:06.501420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:06.502400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:06.503151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 80/158] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:06.522509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.523468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148eda86-ff6b-41bc-88ff-86443be8cc6b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.560648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bb852-c301-44f4-8edc-64ba613c7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.561557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb852-c301-44f4-8edc-64ba613c7bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.561849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb852-c301-44f4-8edc-64ba613c7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.562136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb852-c301-44f4-8edc-64ba613c7bb7 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/de6f57c4de50490fb546b41df71a90c5/roles/8884187957844cf99f36a34b0ef3ae19` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.564251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bb852-c301-44f4-8edc-64ba613c7bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4da631ff0d4917a300966dfb1985a2, user_id=de6f57c4de50490fb546b41df71a90c5, role_id=8884187957844cf99f36a34b0ef3ae19)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.565815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bb852-c301-44f4-8edc-64ba613c7bb7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.584365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 79/159] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:06 2022] PUT /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2/users/de6f57c4de50490fb546b41df71a90c5/roles/8884187957844cf99f36a34b0ef3ae19 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:14:06.637451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.707773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e00fa-c566-4cfc-848c-71bdc8ee6fe7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.753720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.754403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.754755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.754962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.755756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:06.756063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.757476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.770254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cb97-1060-468f-9526-1fbae03dda34 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.770718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cb97-1060-468f-9526-1fbae03dda34 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.770848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 81/160] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.771021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cb97-1060-468f-9526-1fbae03dda34 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.772550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 80/161] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:06.778557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.796140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.796446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.796728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.817881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:06.819101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:06.824247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.920143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 81/162] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:06.970076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.004714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f7016-6c29-4f81-97a6-91b8e6052bf2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.045800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.126825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca56e-ec1a-410e-8840-408b7ad7c50c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.169146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.170037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.170317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.170592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.173949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.174764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.175055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.175340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.176595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.178063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.180112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 82/163] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:07.187445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:07.188826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.194418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:07.202227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:07.204666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:07.205437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 82/164] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:07.210015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.419696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250772d2-10eb-46c0-b64c-cbd74c86758a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.420293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824d081-645a-4cea-9a0c-8e5ec8028e91 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.482442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.483378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.483836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.484282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.485503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:07.486237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.487793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f185023-f215-4bf6-8434-bef59b4df374 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.506609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 83/165] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:07.508221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1313d99-ee3a-4145-b67b-4aa5d0e7e9cf None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.508469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.508858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1313d99-ee3a-4145-b67b-4aa5d0e7e9cf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.509130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.509418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.509662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1313d99-ee3a-4145-b67b-4aa5d0e7e9cf None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.509765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.511341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 84/166] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:07.516981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1313d99-ee3a-4145-b67b-4aa5d0e7e9cf None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.617009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.641736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.697115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.699116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.705982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1313d99-ee3a-4145-b67b-4aa5d0e7e9cf None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.779635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84f21-f138-4532-b832-315c0af25d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.780786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84f21-f138-4532-b832-315c0af25d94 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.781221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84f21-f138-4532-b832-315c0af25d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.781668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84f21-f138-4532-b832-315c0af25d94 None admin] PATH_INFO: `/v3/users/725291ff274c49f98fe318d9ba9e0802` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.784967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84f21-f138-4532-b832-315c0af25d94 None admin] RBAC: Authorizing `identity:get_user(user_id=725291ff274c49f98fe318d9ba9e0802)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.787058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84f21-f138-4532-b832-315c0af25d94 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.788891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 85/167] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/users/725291ff274c49f98fe318d9ba9e0802 => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:07.790190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.791887 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.792533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.825193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:07.826649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:07.930358 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 86/168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:07.931233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.962851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 83/169] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:07.966869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.011325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.059718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2fb98-f35d-47ec-b7e8-9fca90c6f333 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.098380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.099052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.099341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.099622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.186336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.205857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.208040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.233885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50367d78-5516-4587-b582-108b9a0570d4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.288242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.320824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 87/170] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:08.324626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.336648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f80fb3-f0ff-4c23-a605-e642bd2927bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.338783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80fb3-f0ff-4c23-a605-e642bd2927bd None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.339293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80fb3-f0ff-4c23-a605-e642bd2927bd None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.339795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f80fb3-f0ff-4c23-a605-e642bd2927bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.365075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f80fb3-f0ff-4c23-a605-e642bd2927bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d9f80fb3-f0ff-4c23-a605-e642bd2927bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:08.381135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:08.382054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:08.382839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 84/171] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:08.384092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb5528-0671-4f76-a94a-97aa648763cf None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.384293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb5528-0671-4f76-a94a-97aa648763cf None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.384641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb5528-0671-4f76-a94a-97aa648763cf None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.386307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 85/172] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:08.396775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb5528-0671-4f76-a94a-97aa648763cf None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.448398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c78a-41ec-450a-b418-5ab11650f6d5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.491707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb605-754c-43a2-8dda-cdf1a656962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.492958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb605-754c-43a2-8dda-cdf1a656962d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.495403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb605-754c-43a2-8dda-cdf1a656962d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.495944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb605-754c-43a2-8dda-cdf1a656962d None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.497441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb605-754c-43a2-8dda-cdf1a656962d None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.499322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb605-754c-43a2-8dda-cdf1a656962d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.503546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 88/173] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:08.506348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.507663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.511127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.540487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:08.543360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:08.589676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.609303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb5528-0671-4f76-a94a-97aa648763cf None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.684661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 89/174] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:08.685538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.687899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.688765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.689050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.689331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.692287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.693766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.695462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 86/175] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:08.696245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.709354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.829955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0d58-8143-457e-9d75-efa95c05daf8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.832223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0291e-6d00-4f68-8a8d-de231e5fd125 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.864825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.865771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.866063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.866347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.867187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] RBAC: Adding query filter params (role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=23a8bb99dc8d4e7092a8bf1a6d09759c) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:08.867504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.869118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.869906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.871005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.871478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.871834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.872637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:08.872958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.874320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29ce7-6ee8-42e6-aaea-b8110c5c660f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.887852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 87/176] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/role_assignments?user.id=23a8bb99dc8d4e7092a8bf1a6d09759c&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:08.887852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.888151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 90/177] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:08.888151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9760a-92fc-4039-9246-36fb17bde476 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.888151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9760a-92fc-4039-9246-36fb17bde476 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.888151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9760a-92fc-4039-9246-36fb17bde476 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.888151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 91/178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:08.888151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9760a-92fc-4039-9246-36fb17bde476 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.912412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.988726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.025085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180793-3f0a-446f-8e3c-f681b69f0c98 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.031226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9760a-92fc-4039-9246-36fb17bde476 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.075620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.076454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.076986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.077479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.078672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=725291ff274c49f98fe318d9ba9e0802) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:09.079168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.080839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f05e-daac-4de1-a200-66131b558b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.080970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00c967-1efb-4b2c-8ada-4254897eaedd None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.081894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f05e-daac-4de1-a200-66131b558b5b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.082346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f05e-daac-4de1-a200-66131b558b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.082766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f05e-daac-4de1-a200-66131b558b5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.088458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 88/179] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/role_assignments?user.id=725291ff274c49f98fe318d9ba9e0802&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.089978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea8ca-cfd4-4b9a-8189-59e6308e8a7e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.090364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea8ca-cfd4-4b9a-8189-59e6308e8a7e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.090743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea8ca-cfd4-4b9a-8189-59e6308e8a7e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.092158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 89/180] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:09.093073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea8ca-cfd4-4b9a-8189-59e6308e8a7e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.096495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f05e-daac-4de1-a200-66131b558b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-6052f05e-daac-4de1-a200-66131b558b5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:09.106658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.107635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:09.108515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:09.109453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 92/181] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:09.110777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baa8cf-c59b-4c09-acbc-5151cea3ceff None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.111302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baa8cf-c59b-4c09-acbc-5151cea3ceff None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.111700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baa8cf-c59b-4c09-acbc-5151cea3ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.133294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-60baa8cf-c59b-4c09-acbc-5151cea3ceff None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:09.134912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-60baa8cf-c59b-4c09-acbc-5151cea3ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:09.237508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea8ca-cfd4-4b9a-8189-59e6308e8a7e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.240688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 93/182] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:09.247901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.248653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.249165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.279911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.279911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.279911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.279911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] PATH_INFO: `/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.281158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] RBAC: Authorizing `identity:get_user(user_id=23a8bb99dc8d4e7092a8bf1a6d09759c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.281715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:09.282706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.283372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:09.284662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 90/183] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/users/23a8bb99dc8d4e7092a8bf1a6d09759c => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.285278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.292535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.295145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.389333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 94/184] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:09.389333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.425326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e559d7-97d3-49cb-9eac-368e24ac2d7e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.468082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.468786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.469075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.469354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.470163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:09.470474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.471953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.488503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 91/185] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.490125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.513589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf86fb5-8d30-471e-8ef7-be14c6909f5d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.547484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.548172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.548462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.548743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.557985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.564533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.598679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cf901-d7d5-48b6-ab36-53f834ee6317 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.621223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.622743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.633290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.634104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.634390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.634779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.645045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:09.653619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.654468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:09.655317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:09.659610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 92/186] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:09.660325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.722531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 95/187] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:09.723456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.762618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.767923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36ad9-9f60-4723-9820-97848e1df64f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.793237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.802157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231dc89-e6e5-4ae2-8600-1d4746296eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.802958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231dc89-e6e5-4ae2-8600-1d4746296eed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.803246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231dc89-e6e5-4ae2-8600-1d4746296eed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.803523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231dc89-e6e5-4ae2-8600-1d4746296eed None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.804721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231dc89-e6e5-4ae2-8600-1d4746296eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.806176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231dc89-e6e5-4ae2-8600-1d4746296eed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.808426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 93/188] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.809617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a36f9-67c9-4ef5-a07f-b36ce93ee6cb None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.809906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a36f9-67c9-4ef5-a07f-b36ce93ee6cb None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.810187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a36f9-67c9-4ef5-a07f-b36ce93ee6cb None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.811419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 94/189] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:09.812146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a36f9-67c9-4ef5-a07f-b36ce93ee6cb None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.827519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778cfe0-c7be-4cb6-9a2f-53e45f102c63 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.861996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.862874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.863162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.863442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] PATH_INFO: `/v3/users/2ce1532c5175407183a7ef89aa976979` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.876513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2ce1532c5175407183a7ef89aa976979)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.877967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.879640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 96/190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/users/2ce1532c5175407183a7ef89aa976979 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.880441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.919947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a36f9-67c9-4ef5-a07f-b36ce93ee6cb None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.952218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.952882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.953175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.953457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.954205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:09.954517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.955970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.964348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 95/191] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.965126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.975207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.982966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9cd6-4d68-480d-9a8b-d69bdad3c4b1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.016014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4417379-f375-48c6-b11a-14c4038594c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.016892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4417379-f375-48c6-b11a-14c4038594c2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.017180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4417379-f375-48c6-b11a-14c4038594c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.017465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4417379-f375-48c6-b11a-14c4038594c2 None admin] PATH_INFO: `/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.018699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4417379-f375-48c6-b11a-14c4038594c2 None admin] RBAC: Authorizing `identity:get_project(project_id=816b423ccafe47e8b2a6131d41d5cf4f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.019960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.020209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4417379-f375-48c6-b11a-14c4038594c2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.022790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 97/192] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/projects/816b423ccafe47e8b2a6131d41d5cf4f => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.024378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.024672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.024958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:10.047921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:10.068112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7283b-fb5e-4088-aed1-220e59eea25a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.100735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.101651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.101933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.102206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.102901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.105053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.115723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 98/193] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:10.116576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.130447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 96/194] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:09 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:10.131450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.231772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.239932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ee64-2c13-4f23-be6b-55c119c309f4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.253563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd3ab4-20e2-44e3-b8a5-2015d74b80c9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.269321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.280342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.281015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.281303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.281588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.295187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.296091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.296376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.296651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] PATH_INFO: `/v3/users/2ce1532c5175407183a7ef89aa976979` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.298093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] RBAC: Authorizing `identity:get_user(user_id=2ce1532c5175407183a7ef89aa976979)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.299310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.300984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 97/195] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/users/2ce1532c5175407183a7ef89aa976979 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.302059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.365604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.367788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.422916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3919bdf-1ea4-4018-a28d-09b63671cc5e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.460110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.460780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.461065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.461345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.462182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=816b423ccafe47e8b2a6131d41d5cf4f, user.id=23a8bb99dc8d4e7092a8bf1a6d09759c) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:10.462500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.464112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.470262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 98/196] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/role_assignments?user.id=23a8bb99dc8d4e7092a8bf1a6d09759c&scope.project.id=816b423ccafe47e8b2a6131d41d5cf4f&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.471131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.500469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.509905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 99/197] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:10.510874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.534126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.618496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f3bbc-d39c-48e8-bc11-f7db1423f5c8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.635089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f999743-085f-47c2-bc0f-7c92bbd25ac2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.669170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.669994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.670392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.670684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.673522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.674286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.674697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.675084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.686400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:10.695848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:10.696803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:10.698168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 99/198] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:10.698835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.750811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.762528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.765683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.843041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f67fc-ca73-4b5f-b63d-60cfae7c98f9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.860389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.891404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 100/199] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:10.891404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.897719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.898787 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.899240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.900413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.902443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.904707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.906955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 100/200] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.908416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.028093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.037402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6489b54-9ec1-42bc-a8a5-e50d6cac2119 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.043308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9a254-e1cb-4856-83b9-9440bcb2cdda None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.088283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.088283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.088283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.088283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.088834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.088903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.088995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.089072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.089072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.089072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.089238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.089310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.090184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.093762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 101/201] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.094595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.097833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 101/202] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.098678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.144128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.207542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0d9c-4efd-412f-9b8d-de2a4f78e087 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.217667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1dca9-cce8-434d-9787-2bb797362257 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.245952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.247038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.247557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.248100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.249339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=2ce1532c5175407183a7ef89aa976979) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.249862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.251505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.254254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.255083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.255438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.255789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.256734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] RBAC: Adding query filter params (role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=2ce1532c5175407183a7ef89aa976979) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.257117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.258684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.264325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 102/203] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/role_assignments?user.id=2ce1532c5175407183a7ef89aa976979&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.265064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 102/204] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/role_assignments?user.id=2ce1532c5175407183a7ef89aa976979&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.265840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.381205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c51448-6f2d-4a2c-b107-b7bd02a2e98a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.384093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.431937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.433291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.433816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.434299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] PATH_INFO: `/v3/users/de6f57c4de50490fb546b41df71a90c5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.435923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] RBAC: Authorizing `identity:get_user(user_id=de6f57c4de50490fb546b41df71a90c5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.437666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.439771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 103/205] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/users/de6f57c4de50490fb546b41df71a90c5 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.449113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.482052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.578458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b5632-33a3-4abb-830e-57f5bbd0ab1e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.620011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.621066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.621548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.622046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.716820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.718617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.760044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.853883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 103/206] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:11.859622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.992171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a059d9-e568-4a6a-91d5-88c58a5609c2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.054088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25041c6-1ea6-418c-931c-0ede91f10fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.054852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25041c6-1ea6-418c-931c-0ede91f10fad None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.055141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25041c6-1ea6-418c-931c-0ede91f10fad None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.055425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25041c6-1ea6-418c-931c-0ede91f10fad None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.056916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25041c6-1ea6-418c-931c-0ede91f10fad None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.058441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25041c6-1ea6-418c-931c-0ede91f10fad None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.060516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 104/207] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:12.068992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.211857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721b8d-92ec-4984-9133-60d01d57b288 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.233854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.249548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.250216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.250506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.250786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.251637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] RBAC: Adding query filter params (role.id=8884187957844cf99f36a34b0ef3ae19, scope.project.id=db4da631ff0d4917a300966dfb1985a2, user.id=de6f57c4de50490fb546b41df71a90c5) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:12.251989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.253433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1318c608-8916-4500-b021-2647fc0d5167 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.259730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 104/208] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/role_assignments?user.id=de6f57c4de50490fb546b41df71a90c5&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=8884187957844cf99f36a34b0ef3ae19 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:12.776473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb076759-8b96-41a8-822f-1e977b054734 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.776836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb076759-8b96-41a8-822f-1e977b054734 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.777046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb076759-8b96-41a8-822f-1e977b054734 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.778570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 105/209] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:12.784166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.786711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.786711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.802918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:12.804480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:12.820837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470c68f-a31d-4f7e-a05b-f8cba4b3a828 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.821491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470c68f-a31d-4f7e-a05b-f8cba4b3a828 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.821967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470c68f-a31d-4f7e-a05b-f8cba4b3a828 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.824471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 106/210] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:12.836310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.837085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.838482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.861303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:12.863231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:12.899405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.908663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 105/211] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:12.931237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.943274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 107/212] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:12.969802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.036556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f309-d150-4ad5-aaa4-8a4d0ea0f411 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.055912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.074157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.075171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.075692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.076088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.082459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66e79f-e041-4fab-89a9-3ecb8ad393f5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.089477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:13.099798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:13.100862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:13.102093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:13.104129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 106/213] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:13.109178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.125978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.126912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.127315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.127691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.129178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.130715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.132855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 108/214] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:13.138922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.184018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.219527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f106448-bca3-46d8-a08b-efaa8eb84f21 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.252556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6eb98-767b-4cc4-a754-60a8bc45aea7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.256785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111b90-0266-492d-b765-25b879d034fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.257654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111b90-0266-492d-b765-25b879d034fc None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.258090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111b90-0266-492d-b765-25b879d034fc None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.258518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111b90-0266-492d-b765-25b879d034fc None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.259423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27111b90-0266-492d-b765-25b879d034fc None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:13.259959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27111b90-0266-492d-b765-25b879d034fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.261702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27111b90-0266-492d-b765-25b879d034fc None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.271208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 107/215] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:13.277034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111b90-0266-492d-b765-25b879d034fc None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.289831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.291587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.292306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.292789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.293841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.296466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.319613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.325652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 109/216] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:13 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:13.405233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111b90-0266-492d-b765-25b879d034fc None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.444866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.445774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.446064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.446654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] PATH_INFO: `/v3/users/15f807faa42b4b608059795f54327687` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.464458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] RBAC: Authorizing `identity:get_user(user_id=15f807faa42b4b608059795f54327687)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.465954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.467809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 108/217] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/users/15f807faa42b4b608059795f54327687 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:13.473669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.580293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.589957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c49d-6324-4171-b2b2-e945a0037081 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.626870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ea7e4-3c6f-4720-8f19-b0bf509772f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.627539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ea7e4-3c6f-4720-8f19-b0bf509772f7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.627830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ea7e4-3c6f-4720-8f19-b0bf509772f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.628148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ea7e4-3c6f-4720-8f19-b0bf509772f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.703767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ea7e4-3c6f-4720-8f19-b0bf509772f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.705306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ea7e4-3c6f-4720-8f19-b0bf509772f7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.827557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.836964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 110/218] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:13.843474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.885062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e85e-597d-43e2-9212-6816980a4f40 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.886080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e85e-597d-43e2-9212-6816980a4f40 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.886583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e85e-597d-43e2-9212-6816980a4f40 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.888543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 111/219] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:13.911366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7a27-ec7b-4c64-a46f-a74e7ac2a49c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.911816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7a27-ec7b-4c64-a46f-a74e7ac2a49c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.912300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7a27-ec7b-4c64-a46f-a74e7ac2a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.957444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-789e7a27-ec7b-4c64-a46f-a74e7ac2a49c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:13.959381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-789e7a27-ec7b-4c64-a46f-a74e7ac2a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:14.039710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 112/220] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:14.042003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbc5c7-8aaf-43bd-a30e-67d8fb9e2537 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.042297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbc5c7-8aaf-43bd-a30e-67d8fb9e2537 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.042580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbc5c7-8aaf-43bd-a30e-67d8fb9e2537 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.044023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 113/221] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:14.054499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.054792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.055071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.065854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.071004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37cfac-2271-4266-ad3d-c7b4b235854e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.082080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:14.083408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:14.110872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.111748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.112167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.112451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.113672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.115365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.117458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 109/222] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:14.118265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.156885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 114/223] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:14.158111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.217026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.247251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89a77-26c4-443a-9eae-dac1a6cf69b5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.264773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe9722-611b-47df-b93a-fb6c35f69ba3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.283083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.283937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.284231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.284511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.295390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:14.301521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.302284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.302667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.303037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:14.303522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:14.304413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:14.305189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:14.305776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=15f807faa42b4b608059795f54327687) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.305776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.305915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 110/224] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:14.305915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.311659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.318321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 115/225] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/role_assignments?user.id=15f807faa42b4b608059795f54327687&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.319238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.348596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.454672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066641-e551-41b7-ad81-f3f774608dd5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.484469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.499000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.499699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.500328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.500615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.501410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.501721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.503149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.516869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21478ec-009d-4954-b9fd-10f8f795953b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.531246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 116/226] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.536873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.617703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.622091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.622594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.623078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.643807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:14.652530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:14.653377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:14.654153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:14.661981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 111/227] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:14.667906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.694958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064db4a6-96ea-4cd4-b811-6000d6ac351a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.751604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.770227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.771446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.771957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.772061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261b16-811c-4db2-8bfc-b641df877879 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.772553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] PATH_INFO: `/v3/users/2ce1532c5175407183a7ef89aa976979` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.777416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] RBAC: Authorizing `identity:get_user(user_id=2ce1532c5175407183a7ef89aa976979)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.779143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.781182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/users/2ce1532c5175407183a7ef89aa976979 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:14.786565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.812510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.813201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.813496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.813784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.814551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.814867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.816272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.840693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.845413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.920248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.975454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093721-2be1-49b5-ab50-863cc22ed6b4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.015371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.016346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.016623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.016895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] PATH_INFO: `/v3/users/2ce1532c5175407183a7ef89aa976979` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.018279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] RBAC: Authorizing `identity:get_user(user_id=2ce1532c5175407183a7ef89aa976979)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.020120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.022281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 113/230] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/users/2ce1532c5175407183a7ef89aa976979 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:15.028220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.032689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bde93-ef22-4add-b3df-1a49d4ed10ed None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.059228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.111456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.112359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.112642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.112918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.114087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.115557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.117277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 118/231] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:15.140907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.269532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c76d4e-02f1-4b83-9e05-7fdb7ae39174 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.277850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2889eac-8c3e-4aff-8d38-159c4cca94be None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.300289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.308500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.309408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.309689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.309962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508/users/2ce1532c5175407183a7ef89aa976979/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.312266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff953b92359641cd843b50a70673e508, user_id=2ce1532c5175407183a7ef89aa976979, role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.314217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.330971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 119/232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:15 2022] PUT /identity/v3/projects/ff953b92359641cd843b50a70673e508/users/2ce1532c5175407183a7ef89aa976979/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:15.381655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aaba9-5ff0-4ac4-be9f-0c34c274d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.383023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aaba9-5ff0-4ac4-be9f-0c34c274d2bf None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.383318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aaba9-5ff0-4ac4-be9f-0c34c274d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.383605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aaba9-5ff0-4ac4-be9f-0c34c274d2bf None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.385533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aaba9-5ff0-4ac4-be9f-0c34c274d2bf None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.387013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aaba9-5ff0-4ac4-be9f-0c34c274d2bf None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.389206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 114/233] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:15.395093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.557432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c109-3a1d-41d5-a191-64c484308152 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.601983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598696-88bd-4c8d-88e2-e0745e91ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.602896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598696-88bd-4c8d-88e2-e0745e91ebfa None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.603184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598696-88bd-4c8d-88e2-e0745e91ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.604131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598696-88bd-4c8d-88e2-e0745e91ebfa None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508/users/2ce1532c5175407183a7ef89aa976979/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.607568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598696-88bd-4c8d-88e2-e0745e91ebfa None admin] RBAC: Authorizing `identity:create_grant(project_id=ff953b92359641cd843b50a70673e508, user_id=2ce1532c5175407183a7ef89aa976979, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.609076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598696-88bd-4c8d-88e2-e0745e91ebfa None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.629101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:15 2022] PUT /identity/v3/projects/ff953b92359641cd843b50a70673e508/users/2ce1532c5175407183a7ef89aa976979/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:16.006648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb363-374e-4b27-b5d7-3e0deaa8e752 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.007152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb363-374e-4b27-b5d7-3e0deaa8e752 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.007227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb363-374e-4b27-b5d7-3e0deaa8e752 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.008608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 115/235] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:16.014490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d1bf-7af2-43f1-ab66-2795e2727917 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.014926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d1bf-7af2-43f1-ab66-2795e2727917 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.015116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d1bf-7af2-43f1-ab66-2795e2727917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.036865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8f74d1bf-7af2-43f1-ab66-2795e2727917 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:16.038067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8f74d1bf-7af2-43f1-ab66-2795e2727917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:16.078358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.119074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 121/236] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:16.156519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb363-374e-4b27-b5d7-3e0deaa8e752 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.238923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dfcfe-412d-4a01-9efb-73a70f0fdbec None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.239245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dfcfe-412d-4a01-9efb-73a70f0fdbec None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.239493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dfcfe-412d-4a01-9efb-73a70f0fdbec None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.241163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 122/237] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:16.245944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.246239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.246513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.270735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.276387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:16.277582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:16.304551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb363-374e-4b27-b5d7-3e0deaa8e752 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.354571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.355386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.355675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.356049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.360593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.362064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.364060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 116/238] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:16.365604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 123/239] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:16.370222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.398666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.555267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154975c-f5cf-4ae0-ae4a-3f99eec11b94 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.579662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.590878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa2b75-509c-4c41-afeb-528d60b44e70 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.628246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.629148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.629440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.629719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.637526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.638227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.638518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.638804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.639533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.641013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.641120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:16.648828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:16.649701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:16.651582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 124/240] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:16.659651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.698910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 117/241] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:16 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:16.782682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ea360-0a81-496d-918e-83abac043f2b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.823789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.824432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.824715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.824993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.825770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:16.826079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.827552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31bbe-e875-4fec-931c-2f4a2e39b6da None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.837345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 125/242] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:16.843729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.847747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.907030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1e4c-789b-4dc2-8ec9-de4ddd8b1642 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.907684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1e4c-789b-4dc2-8ec9-de4ddd8b1642 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.908191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1e4c-789b-4dc2-8ec9-de4ddd8b1642 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.911626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 126/243] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:16.916328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.916948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.917431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.934454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:16.936925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:16.952768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.966177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3e975-eae6-4f45-a21f-3c7fc59843b5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.011309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.013101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.013619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.014103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] PATH_INFO: `/v3/users/cb74c83fe0f14e23afaebe5dc20808b6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.026063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 127/244] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:17.031068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cb74c83fe0f14e23afaebe5dc20808b6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.032779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.034779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 118/245] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/users/cb74c83fe0f14e23afaebe5dc20808b6 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:17.040559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.051715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.135794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.174578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a9cac-2804-439b-af22-94ae1ccb04e3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.192266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aa117-8ba2-448c-a96e-16131672a3d9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.221493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.222157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.222691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.222979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.239960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.241125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.241676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.242251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.245703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.260174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:17.270601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:17.271478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:17.272435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:17.279958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 119/246] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:17.284881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.302782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.304289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.424989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 128/247] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:17.430258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.435059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c5fb-b3f7-41be-b562-8190caa38ea8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.463171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.479687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.481049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.481450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.481836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.483120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:17.483539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.486060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.490806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.500785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 120/248] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:17.505405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.548997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb63e7b-35f7-4c91-9cc8-22a4c1d828e8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.587169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.589731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.590021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.590305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.592239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.594981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.595601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 129/249] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:17.602973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.645112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a58a-faa8-4f71-bfc6-4cbdb59664b9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.687495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.688880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.689171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.689454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] PATH_INFO: `/v3/users/15f807faa42b4b608059795f54327687` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.690680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] RBAC: Authorizing `identity:get_user(user_id=15f807faa42b4b608059795f54327687)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.692329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.695035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 121/250] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/users/15f807faa42b4b608059795f54327687 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:17.704048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.766998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1372a-9b24-4b68-9db3-b3a12ac17376 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.793731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.814845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.815626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.815946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.816235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.817082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] RBAC: Adding query filter params (role.id=8884187957844cf99f36a34b0ef3ae19, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=cb74c83fe0f14e23afaebe5dc20808b6) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:17.817402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.818662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.819641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.827404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 130/251] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/role_assignments?user.id=cb74c83fe0f14e23afaebe5dc20808b6&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=8884187957844cf99f36a34b0ef3ae19 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:17.877705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134f8cc-0cdf-43b0-8a29-b033e20e054a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.915413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc109c-4e97-4bc1-9cf3-818348113f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.916883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc109c-4e97-4bc1-9cf3-818348113f2b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.917175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc109c-4e97-4bc1-9cf3-818348113f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.917459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc109c-4e97-4bc1-9cf3-818348113f2b None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.918718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc109c-4e97-4bc1-9cf3-818348113f2b None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.920223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc109c-4e97-4bc1-9cf3-818348113f2b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.922171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 122/252] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:17 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:17.928234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.048699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8228135-9784-453d-8ce6-ef751b84f8ff None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:18.085785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e657-4708-4316-8533-9e830fc6e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:18.086689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e657-4708-4316-8533-9e830fc6e40c None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.086973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e657-4708-4316-8533-9e830fc6e40c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.087249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e657-4708-4316-8533-9e830fc6e40c None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508/users/15f807faa42b4b608059795f54327687/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.090132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e657-4708-4316-8533-9e830fc6e40c None admin] RBAC: Authorizing `identity:create_grant(project_id=ff953b92359641cd843b50a70673e508, user_id=15f807faa42b4b608059795f54327687, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:18.091626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e657-4708-4316-8533-9e830fc6e40c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:18.114598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 131/253] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:17 2022] PUT /identity/v3/projects/ff953b92359641cd843b50a70673e508/users/15f807faa42b4b608059795f54327687/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:18.437499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed04df-fb28-4582-9b7a-daffc2d661ed None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.437976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed04df-fb28-4582-9b7a-daffc2d661ed None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.438049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed04df-fb28-4582-9b7a-daffc2d661ed None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.439698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 123/254] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:18.452836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.453451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.453931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.472292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:18.473834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:18.517965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:18.558616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 132/255] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:18.599230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed04df-fb28-4582-9b7a-daffc2d661ed None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.765755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed04df-fb28-4582-9b7a-daffc2d661ed None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:18.795142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:18.814031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461577-21ef-40eb-aead-58901cd45260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:18.814848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461577-21ef-40eb-aead-58901cd45260 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.815132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461577-21ef-40eb-aead-58901cd45260 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.815407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461577-21ef-40eb-aead-58901cd45260 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.829577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461577-21ef-40eb-aead-58901cd45260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-51461577-21ef-40eb-aead-58901cd45260 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:18.838510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:18.839801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:18.840619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:18.844157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 124/256] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:18.845874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.932408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f8c6-d6dc-4a0a-8b75-3146d12b765c None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.933267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f8c6-d6dc-4a0a-8b75-3146d12b765c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.933560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f8c6-d6dc-4a0a-8b75-3146d12b765c None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.935462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 125/257] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:18.942226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.942695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.943361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.975361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:18.977184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:19.019446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e5f64-235f-4a93-b24e-8c1f8d46d119 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.116968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.117805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.118419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.118980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.119531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 126/258] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:19.120593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:19.120925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.122432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.139421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 133/259] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:19.144616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.160317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.257206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.306142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cddc2-625a-4eda-9353-65e6f61313de None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.327467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.384389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813833-3b6c-417a-a2ab-68e51b499fed None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.401765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.402670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.402961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.403244 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] PATH_INFO: `/v3/users/2ce1532c5175407183a7ef89aa976979` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.404525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ce1532c5175407183a7ef89aa976979)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.405979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.411999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 127/260] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/users/2ce1532c5175407183a7ef89aa976979 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:19.412809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.445486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.446292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.446584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.446866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.464983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:19.480823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:19.482985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:19.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 134/261] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:19.488556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.634979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f3cf-cd44-4ed8-86fb-b2048ab3c6b4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.652254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.662908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4957d6-27b4-4891-9aba-66f9d17e479c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.703037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.703695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.704006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.704288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.728196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.729563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.729851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.730133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.730892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:19.731202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.732626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.743744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 135/262] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:19.750176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.796834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.840336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.841812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.920153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723d50-6b90-4d6f-93a3-6a15cc76f9e0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.955546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.956469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.956754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.957028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] PATH_INFO: `/v3/users/2ce1532c5175407183a7ef89aa976979` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.958224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ce1532c5175407183a7ef89aa976979)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.959692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.961674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 136/263] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/users/2ce1532c5175407183a7ef89aa976979 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:19.968082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.998959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 128/264] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:20.004718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.018243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.164236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.165591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313497f7-a702-474e-833d-c6923d198da7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.203213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e986ad7-9a17-4238-8095-633c8107b2ef None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.239432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fa878-f417-481c-b14d-60fff5ccabe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.240117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa878-f417-481c-b14d-60fff5ccabe9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.240404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa878-f417-481c-b14d-60fff5ccabe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.240685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa878-f417-481c-b14d-60fff5ccabe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.271403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.272307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.272593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.272883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.274477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.278229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.279375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 129/265] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:20.285457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.373783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fa878-f417-481c-b14d-60fff5ccabe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.375689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fa878-f417-481c-b14d-60fff5ccabe9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.422007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.494196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4574f-7bec-459f-b7b6-151d8d8af9d8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.505949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 137/266] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:14:20.507507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830076-a7e1-4424-be77-6e0c77a2be87 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.507959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830076-a7e1-4424-be77-6e0c77a2be87 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.508370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830076-a7e1-4424-be77-6e0c77a2be87 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.510459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 138/267] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:20.515154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830076-a7e1-4424-be77-6e0c77a2be87 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.553324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.555312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.555748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.557608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.558606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] RBAC: Adding query filter params (role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=2ce1532c5175407183a7ef89aa976979) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:20.562128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.563732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf8c6-d34a-42d1-98e1-3666b6ab657c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.574661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 130/268] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/role_assignments?user.id=2ce1532c5175407183a7ef89aa976979&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:20.587083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcaaef-0494-4f94-b8ac-5b8d0bb8649f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.589732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcaaef-0494-4f94-b8ac-5b8d0bb8649f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.590191 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcaaef-0494-4f94-b8ac-5b8d0bb8649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.637639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e7bcaaef-0494-4f94-b8ac-5b8d0bb8649f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:20.639588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e7bcaaef-0494-4f94-b8ac-5b8d0bb8649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:20.651529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.737809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830076-a7e1-4424-be77-6e0c77a2be87 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.789730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.815135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 131/269] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:20.815912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.817118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.817605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.818124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.820995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330251c3-4783-48ad-a76b-8e90c6fe2e41 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.821288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330251c3-4783-48ad-a76b-8e90c6fe2e41 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.821573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330251c3-4783-48ad-a76b-8e90c6fe2e41 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.823086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.823426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 132/270] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:20.825190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.827170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 139/271] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:20.828810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.829109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.829388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.833209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.877282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:20.878321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:20.987494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 133/272] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:20.988415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.999630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc76e5-9b68-41f2-8b06-2273e0fbe5b4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.045227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.045817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.046103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.046385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.047333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=2ce1532c5175407183a7ef89aa976979) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.047647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.049338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc935-5c8d-4ec5-977c-6f7018a41221 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.057059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 140/273] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/role_assignments?user.id=2ce1532c5175407183a7ef89aa976979&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:21.058382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcde4-a565-4c58-ba62-760527a4919a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.058675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcde4-a565-4c58-ba62-760527a4919a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.058954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fcde4-a565-4c58-ba62-760527a4919a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.061907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 141/274] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:21.061907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fcde4-a565-4c58-ba62-760527a4919a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.106103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.133699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.156253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd964a-f787-4c70-ab8a-8e212e667930 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.199375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fcde4-a565-4c58-ba62-760527a4919a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.200070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d4d83-eff0-4f4f-9061-8f7cc99b5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.200770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4d83-eff0-4f4f-9061-8f7cc99b5f11 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.201060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4d83-eff0-4f4f-9061-8f7cc99b5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.201344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4d83-eff0-4f4f-9061-8f7cc99b5f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.215251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d4d83-eff0-4f4f-9061-8f7cc99b5f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-b54d4d83-eff0-4f4f-9061-8f7cc99b5f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:21.223486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:21.224563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:21.225329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:21.225928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 134/275] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:21.231906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.231906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.231906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.243838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.245228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.245511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.245785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.247093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.247734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:21.248633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.249026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:21.250338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 142/276] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.251138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.330158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 135/277] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:21.330858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.366410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b6cd-9e4f-442a-b1d6-3cd6e72a47a3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.392565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.394269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.405919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.406599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.406883 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.407163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.407927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] RBAC: Adding query filter params (name=member) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.408236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.409604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae46a7-13ec-42fb-aa15-e45d1b4ef720 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.422635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 143/278] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.422635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490fcbc-ba00-4d6a-8495-cab8fd472797 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.422635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490fcbc-ba00-4d6a-8495-cab8fd472797 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.422635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490fcbc-ba00-4d6a-8495-cab8fd472797 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.422635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 144/279] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:21.422635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490fcbc-ba00-4d6a-8495-cab8fd472797 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.440379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917dc33-d4ca-4179-9d41-0bcadcba9eb2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.474039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.474700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.474986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.475266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.475997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.477710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.498644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 136/280] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:21 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:21.499450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.535495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490fcbc-ba00-4d6a-8495-cab8fd472797 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.572681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4b3b-15fb-421e-a0ab-4c51766b5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.574058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4b3b-15fb-421e-a0ab-4c51766b5061 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.574554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4b3b-15fb-421e-a0ab-4c51766b5061 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.575124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4b3b-15fb-421e-a0ab-4c51766b5061 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.591036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c4b3b-15fb-421e-a0ab-4c51766b5061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-464c4b3b-15fb-421e-a0ab-4c51766b5061 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:21.602296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:21.603946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:21.605247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 145/281] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:21.611636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.611636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.611636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.616204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1e65e-8ba2-4137-ae7c-0941839dacec None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.630463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:21.632243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:21.634162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.655324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.656255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.656542 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.656823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] PATH_INFO: `/v3/users/20c2176e2cdc40b5b0b6869c46cdd75e` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.672117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] RBAC: Authorizing `identity:get_user(user_id=20c2176e2cdc40b5b0b6869c46cdd75e)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.674005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.675498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 137/282] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/users/20c2176e2cdc40b5b0b6869c46cdd75e => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.680775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.687737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.723940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 146/283] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:21.725491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.805448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d4bd8-377c-4eeb-9817-7aaffcb67d42 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.848282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.849031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.849318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.849597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.850357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.850945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.852520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.855759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0e3d4-a7ee-42cf-9a26-a28894c700b2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.864425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 138/284] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.864425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.904372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.905311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.905600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.905880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.906720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, user.id=20c2176e2cdc40b5b0b6869c46cdd75e, scope.system=all) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.907318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.908929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.910316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.917253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 147/285] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/role_assignments?user.id=20c2176e2cdc40b5b0b6869c46cdd75e&scope.system=all&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.919402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.975931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:22.046939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e6a00-1547-4ec6-bee1-16c38ca17e4d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.054795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500d84c-2536-455a-bc55-8f00ea0e0a02 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.095912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.096966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.097251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.097787 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] PATH_INFO: `/v3/users/cb74c83fe0f14e23afaebe5dc20808b6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.099078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] RBAC: Authorizing `identity:get_user(user_id=cb74c83fe0f14e23afaebe5dc20808b6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.100503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.103064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 148/286] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/users/cb74c83fe0f14e23afaebe5dc20808b6 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:22.110032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.148700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.149512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.149798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.150086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.161400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:22.169779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:22.170639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:22.171414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 139/287] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:22.182463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.226162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6514b3-d007-4060-8735-8bab5ff6cab5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.240246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:22.266024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.266899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.267180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.267453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.268841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.271367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.275970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 149/288] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:22 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:22.284860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.350946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:22.359306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1bb8e-b3d4-4aff-b5df-3d2c843ad3cc None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.397077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.397759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.398046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.398327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.399082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:22.399393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.401102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.411080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 140/289] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:22.420920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.487714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70388d1f-cec4-47c4-89ef-b3c9af1cf2cb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.524435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.525872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.526160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.526636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508/users/cb74c83fe0f14e23afaebe5dc20808b6/roles/8884187957844cf99f36a34b0ef3ae19` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.528673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=ff953b92359641cd843b50a70673e508, user_id=cb74c83fe0f14e23afaebe5dc20808b6, role_id=8884187957844cf99f36a34b0ef3ae19)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.530220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.557109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 150/290] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:22 2022] PUT /identity/v3/projects/ff953b92359641cd843b50a70673e508/users/cb74c83fe0f14e23afaebe5dc20808b6/roles/8884187957844cf99f36a34b0ef3ae19 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:22.598338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397961c-f704-4d3a-a3c4-0a61008bda18 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.660676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.661490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.661779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.662061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] PATH_INFO: `/v3/users/15f807faa42b4b608059795f54327687` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.664824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=15f807faa42b4b608059795f54327687)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.667025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.669413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 141/291] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:22 2022] GET /identity/v3/users/15f807faa42b4b608059795f54327687 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:22.674869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.747909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:22.824309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f5216-604a-428c-9ff5-def7dfda3fcc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.863426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.864121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.864413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.864692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.959439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.960854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.005101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.099400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 151/292] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:23.105904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.157930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.257624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356ad14-cbf0-4238-8627-84a7754ff5e9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:23.309476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999abcd4-be96-43c4-bf51-24ff4ddb6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:23.310348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999abcd4-be96-43c4-bf51-24ff4ddb6111 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.310688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999abcd4-be96-43c4-bf51-24ff4ddb6111 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.310971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999abcd4-be96-43c4-bf51-24ff4ddb6111 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.312187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999abcd4-be96-43c4-bf51-24ff4ddb6111 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.313620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999abcd4-be96-43c4-bf51-24ff4ddb6111 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.315674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 142/293] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:23 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:23.321419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.455824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04608ec-acca-45a8-997d-54edcd1396db None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:23.491313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:23.492005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.492298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.492583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.493417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=15f807faa42b4b608059795f54327687) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:23.493818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.495953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a477a-3669-45ba-9b69-f2eb1af77bb6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.497831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.502097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 152/294] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:23 2022] GET /identity/v3/role_assignments?user.id=15f807faa42b4b608059795f54327687&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:24.174818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056fab1-f1f5-41e4-955c-f8a689f301ef None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.175786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056fab1-f1f5-41e4-955c-f8a689f301ef None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.176338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056fab1-f1f5-41e4-955c-f8a689f301ef None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.178226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 143/295] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:24.183794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443489b-4939-49b4-a845-282e62d8eae1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.184113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443489b-4939-49b4-a845-282e62d8eae1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.184641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443489b-4939-49b4-a845-282e62d8eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.201921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-9443489b-4939-49b4-a845-282e62d8eae1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:24.203446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9443489b-4939-49b4-a845-282e62d8eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:24.279226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 153/296] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:24.302826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056fab1-f1f5-41e4-955c-f8a689f301ef None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.319398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1640-dbf1-493d-949e-64bfe18de12f None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.319761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1640-dbf1-493d-949e-64bfe18de12f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.320014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b1640-dbf1-493d-949e-64bfe18de12f None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.321893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 154/297] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:24.327113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aab13-1eaa-4d85-bd06-463cc1bb169e None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.327401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aab13-1eaa-4d85-bd06-463cc1bb169e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.327682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aab13-1eaa-4d85-bd06-463cc1bb169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.346407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2f8aab13-1eaa-4d85-bd06-463cc1bb169e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:24.347741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2f8aab13-1eaa-4d85-bd06-463cc1bb169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:24.410139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.419228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056fab1-f1f5-41e4-955c-f8a689f301ef None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.429916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 155/298] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:24.431104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428a87c-43a3-4714-bef0-764407af8c44 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.431448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428a87c-43a3-4714-bef0-764407af8c44 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.431983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428a87c-43a3-4714-bef0-764407af8c44 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.433411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 156/299] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:24.438252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.438597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.438833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.459528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:24.460952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:24.462445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.464111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.464403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.464682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.475126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:24.483165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:24.484279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:24.485106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 144/300] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:24.485754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.528176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.543942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 157/301] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:24.543942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.611356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ecd25-0731-4bd6-8583-47b96fab3943 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.646586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f83310-4a51-4b52-bb3d-eb956ac1ed6f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.648865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.649754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.649939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.650278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.651462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.652951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.654788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 145/302] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.655336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.681755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.688628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.689305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.689619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.689880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.690640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:24.690957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.692393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.702414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 158/303] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.703908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.759671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.768466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e32f6-2538-4303-bbe1-22f5dab600bd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.804499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.805411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.805708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.805988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.814308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c31fe-9f43-47b1-b91b-9107911885c7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.817712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:24.825837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:24.826875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:24.827681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 146/304] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:24.828834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.856812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.857488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.857894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.858177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] PATH_INFO: `/v3/groups` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.858897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.860383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.877282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 159/305] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 16 00:14:24 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:24.878386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.951606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.978439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a846b41-3a24-4157-9136-443e587ea9f1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.992272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395e08-b38a-4d70-8cd5-3abc7ad177ef None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.004954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.032139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.033537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.034016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.034473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.034687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] PATH_INFO: `/v3/users/9d1c69d00782440bbf2b16c1452f8bd7` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.035291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.035651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.036026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.036860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] RBAC: Adding query filter params (name=member) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.037239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.038732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.050650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 160/306] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.058398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.064873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] RBAC: Authorizing `identity:get_user(user_id=9d1c69d00782440bbf2b16c1452f8bd7)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.069640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.077933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 147/307] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/users/9d1c69d00782440bbf2b16c1452f8bd7 => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.079241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.193849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fdf0-fefc-4f0e-ad16-34e79fa9a806 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.206286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358c1d-a8cc-4e9a-ad68-f36158154dab None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.237510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d2689-265d-459d-b2ca-a1aa9ae6708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.238382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d2689-265d-459d-b2ca-a1aa9ae6708f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.238666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d2689-265d-459d-b2ca-a1aa9ae6708f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.238954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d2689-265d-459d-b2ca-a1aa9ae6708f None admin] PATH_INFO: `/v3/users/20c2176e2cdc40b5b0b6869c46cdd75e` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.240201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d2689-265d-459d-b2ca-a1aa9ae6708f None admin] RBAC: Authorizing `identity:get_user(user_id=20c2176e2cdc40b5b0b6869c46cdd75e)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.241887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d2689-265d-459d-b2ca-a1aa9ae6708f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.247906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 161/308] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/users/20c2176e2cdc40b5b0b6869c46cdd75e => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.248045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.248045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.248045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.248045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.248328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45160a84-383f-4c7a-a3ed-dfd614e1932f None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.248328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45160a84-383f-4c7a-a3ed-dfd614e1932f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.248328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45160a84-383f-4c7a-a3ed-dfd614e1932f None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.248505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] RBAC: Adding query filter params (role.id=8884187957844cf99f36a34b0ef3ae19, user.id=9d1c69d00782440bbf2b16c1452f8bd7, scope.system=all) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.248505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.248631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 162/309] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:25.250662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45160a84-383f-4c7a-a3ed-dfd614e1932f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.252498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655318d5-0fb9-4a1a-9601-248fce0285a5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.258292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 148/310] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/role_assignments?user.id=9d1c69d00782440bbf2b16c1452f8bd7&scope.system=all&role.id=8884187957844cf99f36a34b0ef3ae19 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.263917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.263917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.263917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.266258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.278119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:25.279405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:25.310503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.357089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 149/311] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:25.380520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.381196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45160a84-383f-4c7a-a3ed-dfd614e1932f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.428312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.429873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.430245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.431027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] PATH_INFO: `/v3/system/users/20c2176e2cdc40b5b0b6869c46cdd75e/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.433180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=20c2176e2cdc40b5b0b6869c46cdd75e, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.435525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.450050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 163/312] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 16 00:14:25 2022] PUT /identity/v3/system/users/20c2176e2cdc40b5b0b6869c46cdd75e/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:25.504364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7c44c-bd21-4ffd-8bbe-0d33b3063762 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.547093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.547945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.548238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.548521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.550740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.563754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:25.571918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:25.574103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:25.575082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 150/313] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:25.580214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.694186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b9ab1-59b5-40a0-b4b4-256709f23f32 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.696674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.732704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.733299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.733590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.733875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.734631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.734990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.736374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.746069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 164/314] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.751311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.862890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a92ba4-49fd-4c30-8cea-3832794dcdb6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.901272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.902434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.902709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] PATH_INFO: `/v3/users/cb74c83fe0f14e23afaebe5dc20808b6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.903933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] RBAC: Authorizing `identity:get_user(user_id=cb74c83fe0f14e23afaebe5dc20808b6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.905385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.907325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 151/315] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/users/cb74c83fe0f14e23afaebe5dc20808b6 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.912678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.014338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c95bef-5cc9-48f0-a3af-a032d12af119 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.048243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.048907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.049190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.049464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.083685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:26.121241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.122763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.223824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 165/316] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:26.233223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.300388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:26.336616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c30ae-5aa3-4d92-9d80-c38872105e04 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.371327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e80129-1fa1-4474-8544-496cae8689f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.372219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80129-1fa1-4474-8544-496cae8689f1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.372508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80129-1fa1-4474-8544-496cae8689f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.372788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e80129-1fa1-4474-8544-496cae8689f1 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.373957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e80129-1fa1-4474-8544-496cae8689f1 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.375382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e80129-1fa1-4474-8544-496cae8689f1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.377418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 152/317] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:26 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:26.385530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.452527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:26.489245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8dc91-6308-4fcf-a66a-2b4487f0f830 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.524071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.524732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.525021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.525970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.526781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] RBAC: Adding query filter params (role.id=8884187957844cf99f36a34b0ef3ae19, scope.project.id=ff953b92359641cd843b50a70673e508, user.id=cb74c83fe0f14e23afaebe5dc20808b6) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:26.527102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.528577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da06c-7894-46d6-a12c-403b675a1864 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.535103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 166/318] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:26 2022] GET /identity/v3/role_assignments?user.id=cb74c83fe0f14e23afaebe5dc20808b6&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=8884187957844cf99f36a34b0ef3ae19 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:27.165938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb90b-a5e1-4aa5-84b6-8cd04829d719 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.166237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb90b-a5e1-4aa5-84b6-8cd04829d719 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.166737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb90b-a5e1-4aa5-84b6-8cd04829d719 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.168324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 153/319] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:27.173497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.173794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.174082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.191540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:27.192762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:27.266037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 167/320] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:27.288324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb90b-a5e1-4aa5-84b6-8cd04829d719 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.392171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb90b-a5e1-4aa5-84b6-8cd04829d719 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.421236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.428239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08111e92-2869-4f88-8fb6-8b94e49addea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.429041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111e92-2869-4f88-8fb6-8b94e49addea None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.429330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111e92-2869-4f88-8fb6-8b94e49addea None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.429614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111e92-2869-4f88-8fb6-8b94e49addea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.430775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08111e92-2869-4f88-8fb6-8b94e49addea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.432353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08111e92-2869-4f88-8fb6-8b94e49addea None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:27.434140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 154/321] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:27.439384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.500412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.546189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab303-7202-465f-b253-abf0b7558dd9 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.583995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660225da-1717-4abc-8954-074133b09c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.584665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660225da-1717-4abc-8954-074133b09c82 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.584951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660225da-1717-4abc-8954-074133b09c82 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.585229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660225da-1717-4abc-8954-074133b09c82 None admin] PATH_INFO: `/v3/groups` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.585918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660225da-1717-4abc-8954-074133b09c82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.587367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660225da-1717-4abc-8954-074133b09c82 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:27.601449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 168/322] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 16 00:14:27 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:27.604562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9cc5b-1aeb-42ef-b89d-00dd9910f661 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.604702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9cc5b-1aeb-42ef-b89d-00dd9910f661 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.605036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9cc5b-1aeb-42ef-b89d-00dd9910f661 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.606694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 155/323] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:27.612830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.613406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.613864 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.633838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:27.636406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:27.705916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961290b4-6065-4c67-85d7-d81d5eff6157 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.706159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961290b4-6065-4c67-85d7-d81d5eff6157 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.706410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961290b4-6065-4c67-85d7-d81d5eff6157 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.707808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 156/324] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:27.713497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.713697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.713847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.718181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 169/325] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:27.732042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:27.733267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:27.742616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.801141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.816344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 157/326] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:27.839684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.856246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be399964-c58e-4fea-93c4-a88845cc96ef None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.896308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.897112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.897396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.897680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.909357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:27.919915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:27.920795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:27.921898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 170/327] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:27.928556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.970746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab4bf8-5079-471e-93c2-261764688ae1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.007015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.018738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.019149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.019434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.019714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.038099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:28.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:28.047803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:28.048679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 158/328] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:28.053748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.066589 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a6c93-58c9-40d6-aa51-adf16083fc22 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.080751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.123251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.123959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.124244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.124522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.125275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:28.125590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.126974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.138380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 171/329] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:28.143947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.193678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8adb69-7308-4326-886b-5be2ca8b46bb None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.250617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.251314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.252102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.252396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.253170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:28.253492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.254953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.270243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 159/330] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:28.275387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.293779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1226ee4-2f71-4f47-b9a4-b6027adea755 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.334418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.335687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.336213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.336710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] PATH_INFO: `/v3/users/9d1c69d00782440bbf2b16c1452f8bd7` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.341213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] RBAC: Authorizing `identity:get_user(user_id=9d1c69d00782440bbf2b16c1452f8bd7)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.343041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.345323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 172/331] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/users/9d1c69d00782440bbf2b16c1452f8bd7 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:28.347464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.351012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.406783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.435240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a167ef3-9052-4702-9040-08116fdbb8a8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.485311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.486214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.487294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.487584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] PATH_INFO: `/v3/users/20c2176e2cdc40b5b0b6869c46cdd75e` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.489445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] RBAC: Authorizing `identity:get_user(user_id=20c2176e2cdc40b5b0b6869c46cdd75e)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.490975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.493029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 160/332] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/users/20c2176e2cdc40b5b0b6869c46cdd75e => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:28.494018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad56bd-e5e3-4a4e-a1c6-3fce276e803f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.500750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.531918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8aba6-e845-4dd6-9f44-6886091a8423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.531918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8aba6-e845-4dd6-9f44-6886091a8423 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.532182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8aba6-e845-4dd6-9f44-6886091a8423 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.532469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8aba6-e845-4dd6-9f44-6886091a8423 None admin] PATH_INFO: `/v3/system/users/9d1c69d00782440bbf2b16c1452f8bd7/roles/8884187957844cf99f36a34b0ef3ae19` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.533940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8aba6-e845-4dd6-9f44-6886091a8423 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d1c69d00782440bbf2b16c1452f8bd7, role_id=8884187957844cf99f36a34b0ef3ae19)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.535318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8aba6-e845-4dd6-9f44-6886091a8423 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.543544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 173/333] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 16 00:14:28 2022] PUT /identity/v3/system/users/9d1c69d00782440bbf2b16c1452f8bd7/roles/8884187957844cf99f36a34b0ef3ae19 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:14:28.633464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79558ad2-ca25-40ab-9709-a010e4a2095c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.657590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.683667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.684765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.685252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.685730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.686802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] RBAC: Adding query filter params (role.id=0eee518727f846bfb1fccbec6af83ca5, user.id=20c2176e2cdc40b5b0b6869c46cdd75e, scope.system=all) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:28.687502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.689222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7071e27-a1ae-4c69-adf0-4202b5baccd8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.707779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 161/334] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/role_assignments?user.id=20c2176e2cdc40b5b0b6869c46cdd75e&scope.system=all&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:30.325900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e3ee-5dd0-4ca6-8c7f-84eb462547a0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.326891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e3ee-5dd0-4ca6-8c7f-84eb462547a0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.327377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e3ee-5dd0-4ca6-8c7f-84eb462547a0 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.329309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 174/335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:30.334343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548b21-b266-40be-8676-54d498c563b0 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.334796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548b21-b266-40be-8676-54d498c563b0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.334989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548b21-b266-40be-8676-54d498c563b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.356530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9e548b21-b266-40be-8676-54d498c563b0 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:30.357763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9e548b21-b266-40be-8676-54d498c563b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:30.444905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 162/336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:30.485658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e3ee-5dd0-4ca6-8c7f-84eb462547a0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.551226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea2fc1-050a-4a26-a326-e0f2d80eb45c None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.551226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea2fc1-050a-4a26-a326-e0f2d80eb45c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.551226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea2fc1-050a-4a26-a326-e0f2d80eb45c None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.551226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 163/337] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:30.556663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.557150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.557437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.589002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:30.590204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:30.620958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e3ee-5dd0-4ca6-8c7f-84eb462547a0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.636273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.729685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.732229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.732229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.732229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.750308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:30.776109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:30.777045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 175/338] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:30.777813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.804962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 164/339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:30.847151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.963925 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:31.141973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be662f-0d01-40e0-8596-ef9d88be3064 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:31.166780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fb2cd-a768-47a0-a28e-34b20f43cff1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:31.240612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.241310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.241601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.241879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.242643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:31.242955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:31.248422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:31.262773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 176/340] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:31.272979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:31.292726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.293560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.293852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.294332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.334310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:31.344304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:31.368438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:31.370649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:31.371460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:31.372090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 165/341] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 525 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:31.378340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:31.468175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5742c5e-26f0-4477-87f4-c1c7e22fa35f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:31.520298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb3fcb-a340-44f4-a8fa-ef0b8a86c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.520958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb3fcb-a340-44f4-a8fa-ef0b8a86c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.521243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb3fcb-a340-44f4-a8fa-ef0b8a86c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.521520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb3fcb-a340-44f4-a8fa-ef0b8a86c9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.594183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:31.601579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49b91e-d262-416f-b4d8-dc98e59eb4ef None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:31.640268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb3fcb-a340-44f4-a8fa-ef0b8a86c9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:31.641596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb3fcb-a340-44f4-a8fa-ef0b8a86c9e9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:31.661250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.662211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.662660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.663091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.664021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:31.664487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:31.666915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3b6b9-e3a7-430f-8b73-bacb80059af1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:31.672302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:31.677712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 166/342] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:31.679264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a7d2-882a-4f48-9d46-8791e3d4ed73 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.679709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a7d2-882a-4f48-9d46-8791e3d4ed73 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.680291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a7d2-882a-4f48-9d46-8791e3d4ed73 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.687101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 167/343] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:31.688243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a7d2-882a-4f48-9d46-8791e3d4ed73 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:31.803351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a7d2-882a-4f48-9d46-8791e3d4ed73 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:31.840580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 177/344] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:31.841527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb3a5-6b86-4c35-977f-aff4c53a732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.841860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.842154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.842431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.842833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb3a5-6b86-4c35-977f-aff4c53a732b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.843264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb3a5-6b86-4c35-977f-aff4c53a732b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.843685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb3a5-6b86-4c35-977f-aff4c53a732b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.872461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:31.873678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:31.884314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:31.926151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb3a5-6b86-4c35-977f-aff4c53a732b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:31.927597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb3a5-6b86-4c35-977f-aff4c53a732b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.000498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 178/345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:32.001442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.060468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 168/346] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:32.061742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50c82-3d8d-48d3-8cda-0fc0e485ef5d None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.062037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50c82-3d8d-48d3-8cda-0fc0e485ef5d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.062317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc50c82-3d8d-48d3-8cda-0fc0e485ef5d None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.071133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 169/347] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:32.071133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50c82-3d8d-48d3-8cda-0fc0e485ef5d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.071397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.121539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2bc3b-8991-4b11-a1ad-3f0f3e5d5de6 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.135976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.161031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.161908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.162191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.162463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.163744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:32.165384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.168043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 179/348] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:32.168925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.185944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc50c82-3d8d-48d3-8cda-0fc0e485ef5d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.221980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43cae7-f815-4306-84f8-8dff7522b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.222781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43cae7-f815-4306-84f8-8dff7522b51a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.223067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43cae7-f815-4306-84f8-8dff7522b51a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.223344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43cae7-f815-4306-84f8-8dff7522b51a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.234945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43cae7-f815-4306-84f8-8dff7522b51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-4a43cae7-f815-4306-84f8-8dff7522b51a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:32.243626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:32.245888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:32.246738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:32.250235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 170/349] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:32.251610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.252004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.252293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.273691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:32.274875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:32.278673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f5fb1-8d54-4a34-acc7-99cfec67542d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.305371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.320680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.321558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.321844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.322188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.323606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:32.325294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.327084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 180/350] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:32.327850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.349057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 171/351] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:32.350362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.415269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.455724 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce26a-4c1c-4239-a6c4-15adf81917d7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.479666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00e14-48a6-46fe-ac80-b1cd76fcf0bd None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.508501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.510446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.510663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.510953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.518466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:32.520119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.525049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 181/352] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:32.526702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.532434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.533142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.533433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.533711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.534496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:32.534810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:32.536272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.548102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 172/353] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:32.552777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.598404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.657965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be09ed-a65d-4a02-a1dc-0d408eb0c5f0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.688609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c482f-9667-492d-9cfe-48bd60df3369 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.697217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.698326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.698612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.698892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.701043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:32.701809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.702301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.705181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 182/354] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:32.705181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.739065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.740355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.740795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.741082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.756759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:32.765033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:32.766017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:32.766798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 173/355] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:32.768240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.834215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3cc78-d64e-4046-adda-67aeeed56f19 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.864848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:32.878164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.878823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.879108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.879390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.880256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=db4da631ff0d4917a300966dfb1985a2) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:32.880573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:32.881997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9760-5c07-4848-82a1-a8a326a5033f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:32.891414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 183/356] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:32.891604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af974-2e28-4df6-8ebe-b97d5b6028d7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:32.891693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd944-860c-4d97-be27-ef7a1ae833a8 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.891693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd944-860c-4d97-be27-ef7a1ae833a8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.891693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd944-860c-4d97-be27-ef7a1ae833a8 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.892293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 184/357] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:32.892858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd944-860c-4d97-be27-ef7a1ae833a8 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:32.937728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a243c4d-5e2a-4472-957f-e0ab5a572a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:32.938404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243c4d-5e2a-4472-957f-e0ab5a572a4f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.938696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243c4d-5e2a-4472-957f-e0ab5a572a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.938986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a243c4d-5e2a-4472-957f-e0ab5a572a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.996567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.032746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd944-860c-4d97-be27-ef7a1ae833a8 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.039622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a243c4d-5e2a-4472-957f-e0ab5a572a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.041745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a243c4d-5e2a-4472-957f-e0ab5a572a4f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.081511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.082282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.082678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.082966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.083805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=db4da631ff0d4917a300966dfb1985a2) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.084215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.085800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123cb0d-7d3f-427d-826e-595a4c713a6b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.093142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 185/358] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.094503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b25d2-a28b-462d-b46b-3ebe837f8d97 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.094807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b25d2-a28b-462d-b46b-3ebe837f8d97 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.095092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b25d2-a28b-462d-b46b-3ebe837f8d97 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.096687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 186/359] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:33.097476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b25d2-a28b-462d-b46b-3ebe837f8d97 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.169987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.196407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 174/360] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:33.198545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.199136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.200030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.225259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:33.227038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:33.246798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b25d2-a28b-462d-b46b-3ebe837f8d97 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.292655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.293345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.293631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.293911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.294664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.294977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.296447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d6491-920b-446f-bae7-4dac64ce62b9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.307125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 187/361] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.312693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.312989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.313270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.315252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.323562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 175/362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:33.324452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.344906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:33.346108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:33.437413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 188/363] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:33.438200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.455376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb792-5624-4e1b-9b8a-ecc9a7ca1718 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.493092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.510795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.511674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.511990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.512272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.513495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.514955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.516938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 176/364] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.517508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.571826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734d40e-3b45-4b54-ba31-5bd3cd36bef3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.590817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.624627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.626838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.626838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.626838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] PATH_INFO: `/v3/users/9d1c69d00782440bbf2b16c1452f8bd7` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.630408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] RBAC: Authorizing `identity:get_user(user_id=9d1c69d00782440bbf2b16c1452f8bd7)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.630408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.631022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 189/365] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/users/9d1c69d00782440bbf2b16c1452f8bd7 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.631790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.643609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28574058-0740-4a9c-94f1-8a98340db056 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.692085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.693271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.694406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.694902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.710432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:33.724064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:33.725016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:33.725813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:33.729551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 177/366] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:33.730579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.778231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc444-123c-415b-ac9f-9342e96ba893 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.793869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.825875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.827120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.827120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.827354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.840394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:33.848216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:33.849100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:33.849921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 190/367] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:33.850584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.875145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0062e3-e174-44f6-9362-c3ba42488cb4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.906755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.916526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.917636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.918134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.918602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.920042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.921677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.923512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 178/368] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.924504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.967228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b0af-ee36-46d8-a61a-fa758762a0ac None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.006241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.006241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.006536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.006916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.007882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] RBAC: Adding query filter params (role.id=8884187957844cf99f36a34b0ef3ae19, user.id=9d1c69d00782440bbf2b16c1452f8bd7, scope.system=all) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:34.008286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.009979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.024114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 191/369] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/role_assignments?user.id=9d1c69d00782440bbf2b16c1452f8bd7&scope.system=all&role.id=8884187957844cf99f36a34b0ef3ae19 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:34.025044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.041497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f010-78d7-4e4f-b727-3d673667b73a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.062629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.087340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.089727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.090261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.090792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.091832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:34.092389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.094063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.106203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 179/370] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:34.107391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.152049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea39aa2-9a6a-4dd3-9970-a05f549860c1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.198255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.198940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.199224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.199499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.200286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:34.200593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.202000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.221259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 192/371] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:34.222077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.236279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.318946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6dd6c-c9e3-40a1-af89-db47bed69715 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.361677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.372563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d91a-53b8-4dbc-9e48-5f274fb46724 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.373937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.375041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.375529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.376055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.377104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=ff953b92359641cd843b50a70673e508) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:34.377624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.381010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.388524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 180/372] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:34.389631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.410372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.411083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.411364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.411690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.489444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.490852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.563105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ae90-e9ec-4c44-90b8-c097efb7fc08 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.596260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.602321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 193/373] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:34.609249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.620483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.661275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.662307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.662825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.663314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.726360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8707-b574-4153-bb5b-dbf8df3047bd None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.772711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.773123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.773410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.773690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.776665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.778194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.780514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 194/374] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:34.786262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.802501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.804371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.880349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.923428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e45f-a9f4-4fe6-ad35-d9d1c1f89549 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.927668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 181/375] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:34.939929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.963976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.964840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.965119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.965778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.967069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.968700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.970510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 195/376] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:34.977083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.996378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:35.117762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973f85-0f74-4f75-a88a-52edebaccf66 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:35.156851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aabb8-d2b3-43e1-9378-5da119a9017c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:35.174253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:35.190882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:35.191562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.191853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.192174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.193021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=ff953b92359641cd843b50a70673e508) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:35.193338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:35.194793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:35.201806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 196/377] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:35.236796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772d675-ae75-4aeb-8e76-1a5a6c47333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:35.237714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d675-ae75-4aeb-8e76-1a5a6c47333c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.238006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d675-ae75-4aeb-8e76-1a5a6c47333c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.238290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d675-ae75-4aeb-8e76-1a5a6c47333c None admin] PATH_INFO: `/v3/projects/d17e5ca3e11d4286858e2160767efdde` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.239725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d675-ae75-4aeb-8e76-1a5a6c47333c None admin] RBAC: Authorizing `identity:get_project(project_id=d17e5ca3e11d4286858e2160767efdde)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:35.241313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d675-ae75-4aeb-8e76-1a5a6c47333c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:35.243511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 182/378] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/projects/d17e5ca3e11d4286858e2160767efdde => generated 344 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:35.251223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:35.403943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3d725-9b13-4263-ba63-ee9b9926ca13 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:35.410764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212bb08-2803-4ed5-97bd-af1f1ae3b9db None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.411052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212bb08-2803-4ed5-97bd-af1f1ae3b9db None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.411340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212bb08-2803-4ed5-97bd-af1f1ae3b9db None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.412818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 183/379] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:35.418899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.419512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.420073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.446019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:35.447325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:35.470154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:35.471023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.471311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.471593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] PATH_INFO: `/v3/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.477241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] RBAC: Authorizing `identity:get_group(group_id=10ceaa05cdb6453dbd2ac0cd9ab9220f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:35.478898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:35.481077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 197/380] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:35 2022] GET /identity/v3/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:35.486796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:35.555008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 184/381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:35.565805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:35.579231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:35.603656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:35.622303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf783-cbbd-4c71-8908-aff664f11a6f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:35.664029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:35.664941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.665372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.666432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.667430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] RBAC: Adding query filter params (group.id=10ceaa05cdb6453dbd2ac0cd9ab9220f, role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=d17e5ca3e11d4286858e2160767efdde) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:35.667908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:35.669505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:35.675956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 198/382] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:35 2022] GET /identity/v3/role_assignments?group.id=10ceaa05cdb6453dbd2ac0cd9ab9220f&scope.project.id=d17e5ca3e11d4286858e2160767efdde&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:35.721717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161bb20-45b4-4bfe-8479-3d7eb5336e63 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:35.767640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:35.768507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.768794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.769076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.785904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:35.794861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:35.795751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:35.796579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:35.800641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 185/383] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:35.807444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:35.943977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fbee7-0131-4adc-9355-440668a05a72 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:35.974708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:35.993290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:35.994503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.994793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.995077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.995827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:35.996170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:35.997558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f0d31-1e0f-4f5a-b8a2-a163678d4603 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.006403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 199/384] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:36.012680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.135272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.156713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffeadd-f68e-44fb-8c11-1761af7e3288 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.198002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5a2a-7b6f-478c-8478-29c792831a08 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.198294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5a2a-7b6f-478c-8478-29c792831a08 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.198497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5a2a-7b6f-478c-8478-29c792831a08 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.199891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 200/385] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:36.215265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.216164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.216457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.216743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.219436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.220943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.222988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 186/386] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:36.223715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.224048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.224329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.233299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.254387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:36.256116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:36.357393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ad411-c487-483e-978a-80165bc5ed8d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.383050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 201/387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:36.393586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.394656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.395090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.395512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.396891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.398470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.401314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 187/388] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:36.407353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.426920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.456312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.565753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c0bad-d374-4f74-80ff-84ce4be9e96c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.591039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0946df-3d9d-46fb-b622-bd6e7fff8aed None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.610941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.612362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.612884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.613308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.617830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.627555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:36.639529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:36.640512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:36.641319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:36.643426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 188/389] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:36.650841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.713822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.714656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.715111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.715242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2/groups/4c1e054aa5a14400b243f56547817b46/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.717478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] RBAC: Authorizing `identity:create_grant(project_id=db4da631ff0d4917a300966dfb1985a2, group_id=4c1e054aa5a14400b243f56547817b46, role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.718882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.751447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 202/390] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 00:14:36 2022] PUT /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2/groups/4c1e054aa5a14400b243f56547817b46/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:36.751662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.782395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097801-88bd-4d02-9749-719249c37244 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.827908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.828901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.829339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.829823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.830878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:36.831338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.832961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.848086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 189/391] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:36.850970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.980823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edda17-ee0c-4363-9468-804ee15fb3ea None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.023471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.024390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.024675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.024946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.026716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:37.028237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:37.030219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 203/392] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:37.035808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:37.210720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb46df-e4fe-493f-982c-a3bf670bdab3 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.251741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718928-3293-43ec-8047-b111212abb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.252669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718928-3293-43ec-8047-b111212abb2a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.252961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718928-3293-43ec-8047-b111212abb2a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.253242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718928-3293-43ec-8047-b111212abb2a None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.255845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718928-3293-43ec-8047-b111212abb2a None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:37.257344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718928-3293-43ec-8047-b111212abb2a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:37.259387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 190/393] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:37 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:37.265985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:37.341746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:37.371862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127eefb-1178-49a6-a595-7a98c0bd614a None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.372194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127eefb-1178-49a6-a595-7a98c0bd614a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.372512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127eefb-1178-49a6-a595-7a98c0bd614a None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.373844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 191/394] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:37.381049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.381417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.381713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.407623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:37.421233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:37.422344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:37.426450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c5fc6-5730-49f5-a98d-4d6e1ce50d57 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.504497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.505314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.505600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.505880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2/groups/4c1e054aa5a14400b243f56547817b46/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.509630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4da631ff0d4917a300966dfb1985a2, group_id=4c1e054aa5a14400b243f56547817b46, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:37.511774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:37.539598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 204/395] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 00:14:37 2022] PUT /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2/groups/4c1e054aa5a14400b243f56547817b46/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:37.547207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 192/396] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:37.573955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:37.696131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:37.701288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14c0d-1217-4d71-8405-ebe561156145 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.754310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.755179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.755416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.755700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.773306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:37.782464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:37.783371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:37.784823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 205/397] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:37.793406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:37.927808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aa8ab-de66-4f21-94fc-b1865bc5b4d6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.967694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.968409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.968704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.968984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.969754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:37.970068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:37.971461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f5b2a-9de2-46b8-a115-0e96568bb52c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:37.974016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:37.989752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 193/398] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:37.996763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.098713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd86e2-0f45-4488-ad20-73bd8961a41b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.099036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd86e2-0f45-4488-ad20-73bd8961a41b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.099289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd86e2-0f45-4488-ad20-73bd8961a41b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.101022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 194/399] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:38.107125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.107422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.107758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.136120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:38.137341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:38.169227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc61da-7a9f-4a48-ba10-e0143c438562 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.232352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:38.233225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.233514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.233794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.235260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:38.236744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:38.238378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 206/400] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:37 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:38.244860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.269394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 195/401] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 00:14:38.293146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.301052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:38.385166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604570-87c3-4ee0-9c05-88775b672f96 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.446510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:38.447721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.448030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.448308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.449685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:38.451122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:38.453067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 207/402] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:38 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:38.461817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.515597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4731a8f-87ca-4ff2-a360-7afaa9b51376 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.565880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:38.583888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0bf8-1756-4771-aeb5-c5ccfe2a2b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:38.584724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0bf8-1756-4771-aeb5-c5ccfe2a2b1f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.585017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0bf8-1756-4771-aeb5-c5ccfe2a2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.585310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0bf8-1756-4771-aeb5-c5ccfe2a2b1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.610977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b0bf8-1756-4771-aeb5-c5ccfe2a2b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-6a4b0bf8-1756-4771-aeb5-c5ccfe2a2b1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:38.622348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:38.623290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:38.624977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 196/403] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:38.625644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ffd71-6c5f-4c5c-ab66-27319f05baf5 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.625644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ffd71-6c5f-4c5c-ab66-27319f05baf5 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.626007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ffd71-6c5f-4c5c-ab66-27319f05baf5 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.627363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 197/404] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:38.635821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.635821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.635821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.647474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:38.654082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331d393-7258-4c51-ac19-124c99697a1c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.654999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:38.656999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:38.692274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:38.693320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.693701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.694073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508/groups/4c1e054aa5a14400b243f56547817b46/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.696340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff953b92359641cd843b50a70673e508, group_id=4c1e054aa5a14400b243f56547817b46, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:38.698791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:38.717631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 208/405] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 00:14:38 2022] PUT /identity/v3/projects/ff953b92359641cd843b50a70673e508/groups/4c1e054aa5a14400b243f56547817b46/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:38.725170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.756025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 198/406] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:38.772366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.933521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd6117-85dd-4daf-9dc1-315448492798 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.956534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102018f-7200-4f56-8b6f-6ccc4ceb7112 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.979101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:38.980086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:38.981625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.982134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.982605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.983696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:38.984236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:38.987380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:38.999751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 209/407] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.003965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.003965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.003965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.003965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.005903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.021757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:39.028553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:39.034094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:39.034999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:39.035775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:39.039963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 199/408] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:39.042587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.136173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f952-e928-49ca-b236-2b465189bf36 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.149410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb485f7-6cae-44ee-842d-23da035ce815 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.175230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.176489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.177054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.177697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.179129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.181017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.184255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 210/409] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:39.192937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.197939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.198539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.198816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.200232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.200232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:39.200232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.201557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.221370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 200/410] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.229063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.305538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.374499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.399960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0647f49-9579-4bcb-904b-f831d1173133 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.408260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623f92a-dab4-438b-8562-8913dd936765 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.468728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.469512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.469795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.470069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.471644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.473121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.480414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 211/411] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.481598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.482463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.482758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.483038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] PATH_INFO: `/v3/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.485501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] RBAC: Authorizing `identity:get_group(group_id=10ceaa05cdb6453dbd2ac0cd9ab9220f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.486924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.488561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 201/412] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.489386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.493942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.633427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a398d-4572-4be6-aa9f-7ac937746cee None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.680883 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.681883 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.682260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.682450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508/groups/4c1e054aa5a14400b243f56547817b46/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.688348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] RBAC: Authorizing `identity:create_grant(project_id=ff953b92359641cd843b50a70673e508, group_id=4c1e054aa5a14400b243f56547817b46, role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.689799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.712532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c1c8-5cec-424c-a435-2565f95e395b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.719249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 212/413] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 00:14:39 2022] PUT /identity/v3/projects/ff953b92359641cd843b50a70673e508/groups/4c1e054aa5a14400b243f56547817b46/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:39.730048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.765760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef05fd5-dcbf-4143-b1f3-441544835ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.766636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef05fd5-dcbf-4143-b1f3-441544835ea0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.766921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef05fd5-dcbf-4143-b1f3-441544835ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.767196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef05fd5-dcbf-4143-b1f3-441544835ea0 None admin] PATH_INFO: `/v3/projects/d17e5ca3e11d4286858e2160767efdde` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.771363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef05fd5-dcbf-4143-b1f3-441544835ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=d17e5ca3e11d4286858e2160767efdde)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.772928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef05fd5-dcbf-4143-b1f3-441544835ea0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.774990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 202/414] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/projects/d17e5ca3e11d4286858e2160767efdde => generated 344 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.781381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.804382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.895706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564950b-b3b4-431e-a416-38cbbd6c9fa9 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.896082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564950b-b3b4-431e-a416-38cbbd6c9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.896308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564950b-b3b4-431e-a416-38cbbd6c9fa9 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.897972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 203/415] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:39.906654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2157-0ee9-4a36-abe3-61688826cf9c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.906868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ba66-c05e-48d4-a7f2-91342902e7e4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.906868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ba66-c05e-48d4-a7f2-91342902e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.906868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ba66-c05e-48d4-a7f2-91342902e7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.936986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e016ba66-c05e-48d4-a7f2-91342902e7e4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:39.938231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e016ba66-c05e-48d4-a7f2-91342902e7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:39.979731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.980599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.980885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.981165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] PATH_INFO: `/v3/projects/d17e5ca3e11d4286858e2160767efdde/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.987185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] RBAC: Authorizing `identity:create_grant(project_id=d17e5ca3e11d4286858e2160767efdde, group_id=10ceaa05cdb6453dbd2ac0cd9ab9220f, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.988698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.019023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 213/416] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 16 00:14:39 2022] PUT /identity/v3/projects/d17e5ca3e11d4286858e2160767efdde/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:40.053732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 204/417] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:40.095212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.199808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.242790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073fb2-da91-4870-9800-e7790e9f1971 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.287333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23751ae-952d-4227-965e-37d1c7a375b6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.287655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23751ae-952d-4227-965e-37d1c7a375b6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.287938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23751ae-952d-4227-965e-37d1c7a375b6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.289578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 205/418] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:40.292490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.295483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.295609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.295796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.296033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.296153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.296545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.321008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:40.323086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:40.324296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:40.329322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:40.330193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:40.330996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 214/419] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:40.336396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.400568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 206/420] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:40.424185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.450891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31abd5-63a7-412b-a103-85c51dfdcefb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.491132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.492259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.492683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.493178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.494693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:40.495143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.496674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.499170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.504575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.508835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 215/421] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:40.515991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.616571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d94f18-d649-4b08-91e8-eeb79fa64829 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.654460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.655534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.655832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.657737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.701957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1fd55-65c3-4737-b9b3-bfcfabbe958a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.770442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.771608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.771930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.772224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.781976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.785718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:40.794204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:40.795541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:40.796453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:40.797256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:40.797852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 207/422] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:40.798885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.805059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.914174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 216/423] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:14:40.920016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.985369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.997502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56d32-2050-4870-b52b-4a5e4a7fe358 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.077162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.081049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad965-fb63-48ac-831a-66ad2d710200 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.092642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.094003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.094550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.095030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.096077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:41.096588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.098186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.119795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 208/424] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:41.125670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.156622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.158980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.159523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.160281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.162863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.168848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.172811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 217/425] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:41.176968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.291932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bff88-c5fd-464f-8e8c-0decf3de252f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.330819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731adae-6918-42b4-92ba-c486ee3dd0d4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.331186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781c62e-210c-4b86-9096-a58774aa77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.331933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c62e-210c-4b86-9096-a58774aa77c4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.332291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c62e-210c-4b86-9096-a58774aa77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.332637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c62e-210c-4b86-9096-a58774aa77c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.363344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.380360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e7f85-e9de-4eb2-b8b2-c92b17c309ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.381225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e7f85-e9de-4eb2-b8b2-c92b17c309ee None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.381813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e7f85-e9de-4eb2-b8b2-c92b17c309ee None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.382278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e7f85-e9de-4eb2-b8b2-c92b17c309ee None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.383730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e7f85-e9de-4eb2-b8b2-c92b17c309ee None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.385966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e7f85-e9de-4eb2-b8b2-c92b17c309ee None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.388324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 218/426] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:41.389807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de51945-3b93-4cb0-8e6b-66880b1df4d3 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.390097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de51945-3b93-4cb0-8e6b-66880b1df4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.390374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de51945-3b93-4cb0-8e6b-66880b1df4d3 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.395973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 219/427] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:41.397639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de51945-3b93-4cb0-8e6b-66880b1df4d3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.413271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781c62e-210c-4b86-9096-a58774aa77c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.414837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781c62e-210c-4b86-9096-a58774aa77c4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.437026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.525877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 209/428] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:41.527437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.527826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.528225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.538368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de51945-3b93-4cb0-8e6b-66880b1df4d3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.545156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:41.546500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:41.582204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.582791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.583074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.583351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.584232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=db4da631ff0d4917a300966dfb1985a2) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:41.584547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.587454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.601805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 220/429] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:41.603775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.610734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.629046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 210/430] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:41.657123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.812272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.824069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ccb76-1372-44aa-ad79-5020934264b7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.850019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde20a6-db38-457f-814d-244d1a05a0a3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.881511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.882650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.882941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.883475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] PATH_INFO: `/v3/projects/db4da631ff0d4917a300966dfb1985a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.885862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] RBAC: Authorizing `identity:get_project(project_id=db4da631ff0d4917a300966dfb1985a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.887608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.890152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 221/431] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/projects/db4da631ff0d4917a300966dfb1985a2 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:41.894929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.895720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.895833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.896051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.896331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.909236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:41.918297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:41.919245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:41.920066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 211/432] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:41.928388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.003669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.014507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc43c3-c525-41c9-a394-dc4bb3c2d71c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.055768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.057712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.058262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.058745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.060262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.061956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.065940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 222/433] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:42.071188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.071403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d1e01-17cc-49ef-88e2-db4a7a19b5fc None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.107362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.119970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.120650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.120943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.121226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.122573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:42.122883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.125081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.140687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 212/434] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:42.142090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.207450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3fc0-8521-48b5-88bd-b3ee0f25d460 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.264538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.265213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.265507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.265796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.266500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ad308-4b10-4aa9-9832-20d958b946d4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.266678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=db4da631ff0d4917a300966dfb1985a2) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:42.266954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.268427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba7c9-558a-486e-9b54-590eb87d6d46 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.277939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 223/435] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=db4da631ff0d4917a300966dfb1985a2&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:42.279379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.280924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1aee-1073-4a09-8ac5-ef0b0ac66f9e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.281219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1aee-1073-4a09-8ac5-ef0b0ac66f9e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.281504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1aee-1073-4a09-8ac5-ef0b0ac66f9e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.283951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 224/436] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:42.289750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.290061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.290321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.312460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.313541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.314041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.314519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.317271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:42.318893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:42.401808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.403622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.429509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 225/437] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:42.453803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.483201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.535764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 213/438] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:42.542514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.554234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.573381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fe934-c868-4f28-9247-ea079f3421ce None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.615715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.616649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.616936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.617323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.635809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:42.645236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:42.646203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:42.647438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 226/439] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:42.652511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.684640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736460b4-0fd3-4c5a-b304-f5167f6715dc None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.733292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.734556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.735100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.735569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.737059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.738691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.740652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 214/440] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:42.746720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.759154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.778506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832493a6-ef51-4f15-b21d-3f62752007b1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.828863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.829813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.830261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.831041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.832163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:42.832582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.834624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5c110-ddbd-4e00-98c5-6dbfae9ca02d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.846368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 227/441] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:42.848904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32a83-ba79-4ce9-bd3f-a8e7d2c400c1 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.849328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32a83-ba79-4ce9-bd3f-a8e7d2c400c1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.849771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf32a83-ba79-4ce9-bd3f-a8e7d2c400c1 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.851105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 228/442] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:42.856199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf32a83-ba79-4ce9-bd3f-a8e7d2c400c1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.858755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.886747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab092-3f2f-4140-9fad-00614f0c3400 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.931100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b7ba-bd12-4781-9155-4ae620a2d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.932788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b7ba-bd12-4781-9155-4ae620a2d677 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.933079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b7ba-bd12-4781-9155-4ae620a2d677 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.933427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b7ba-bd12-4781-9155-4ae620a2d677 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.934749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b7ba-bd12-4781-9155-4ae620a2d677 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.936528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b7ba-bd12-4781-9155-4ae620a2d677 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.938654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 215/443] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:42.939976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.940359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.940647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.962426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:42.964383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:42.986602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf32a83-ba79-4ce9-bd3f-a8e7d2c400c1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.025287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.026122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.026416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.026700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.035100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 216/444] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:43.035986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.047224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.106488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.107988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.129785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.157792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803637-4132-41df-bae9-2cee7f845d4e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.194159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.194729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.195017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.195294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.196158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=0eee518727f846bfb1fccbec6af83ca5, scope.project.id=ff953b92359641cd843b50a70673e508) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:43.196478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.198174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.204310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 217/445] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=0eee518727f846bfb1fccbec6af83ca5 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:43.205124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.246131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 229/446] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:14:43.247639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.320809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.351816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7425259-d3f4-462f-8379-5c4508d08cb6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.385567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4113ed-dbed-4672-821d-57c725042b91 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.409937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.410520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.410804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.411079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.424207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.430091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:43.436351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.437480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.437780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.438060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] PATH_INFO: `/v3/projects/ff953b92359641cd843b50a70673e508` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:43.438892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:43.439952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:43.440754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:43.441437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] RBAC: Authorizing `identity:get_project(project_id=ff953b92359641cd843b50a70673e508)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.441437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.441554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 218/447] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:43.443449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 230/448] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/projects/ff953b92359641cd843b50a70673e508 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:43.448221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.451513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.579556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ba0c8-1d8f-4f09-bd57-227473630542 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.594014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354417a-9f63-4c66-a50b-8cbd997ba472 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.616663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.630517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.631197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.631482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.631763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.632562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:43.632896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.634292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.641236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.642397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.642696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.642980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] PATH_INFO: `/v3/groups/4c1e054aa5a14400b243f56547817b46` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.644219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] RBAC: Authorizing `identity:get_group(group_id=4c1e054aa5a14400b243f56547817b46)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.644653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 219/449] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:43.645670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.649574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 231/450] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/groups/4c1e054aa5a14400b243f56547817b46 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:43.650723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.656093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:43.715818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.756774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dd718-decc-473c-839c-86ec0016c754 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.765372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc430c7-3e34-4c34-9985-648b03e412c4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:43.793160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.793812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.794101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.794382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.800029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:43.800676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.800960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.801236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.802057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] RBAC: Adding query filter params (group.id=4c1e054aa5a14400b243f56547817b46, role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=ff953b92359641cd843b50a70673e508) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:43.802367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.803802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.809792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 232/451] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/role_assignments?group.id=4c1e054aa5a14400b243f56547817b46&scope.project.id=ff953b92359641cd843b50a70673e508&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:43.871767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:43.873273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:43.937078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:43.979622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 220/452] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:14:43.984800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.036061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.094264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ea2e-7507-4659-8462-481ee07a6793 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.132414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.133283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.133572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.133853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] PATH_INFO: `/v3/projects/d17e5ca3e11d4286858e2160767efdde` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.135475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] RBAC: Authorizing `identity:get_project(project_id=d17e5ca3e11d4286858e2160767efdde)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.136975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.138680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 233/453] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:43 2022] GET /identity/v3/projects/d17e5ca3e11d4286858e2160767efdde => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:44.144457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.241643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddab4-e566-4cd0-91f3-1d406a2ab2e4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.274364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439d1b6-fad1-413e-8dbb-9aed7e087381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.275923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439d1b6-fad1-413e-8dbb-9aed7e087381 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.276215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439d1b6-fad1-413e-8dbb-9aed7e087381 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.276493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439d1b6-fad1-413e-8dbb-9aed7e087381 None admin] PATH_INFO: `/v3/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.277661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439d1b6-fad1-413e-8dbb-9aed7e087381 None admin] RBAC: Authorizing `identity:get_group(group_id=10ceaa05cdb6453dbd2ac0cd9ab9220f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.279080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439d1b6-fad1-413e-8dbb-9aed7e087381 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.280712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 221/454] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/groups/10ceaa05cdb6453dbd2ac0cd9ab9220f => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:44.286693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.383248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c11c6-5136-46bd-81ae-79a89b95807c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.400023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.417742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.418393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.418682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.418964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.419788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] RBAC: Adding query filter params (group.id=10ceaa05cdb6453dbd2ac0cd9ab9220f, role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=d17e5ca3e11d4286858e2160767efdde) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:44.420134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.421587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6903c5-1932-4112-a1c1-f0dbfa09830d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.427247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 234/455] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/role_assignments?group.id=10ceaa05cdb6453dbd2ac0cd9ab9220f&scope.project.id=d17e5ca3e11d4286858e2160767efdde&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:47.030079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5a5c-0c65-4ee6-a1c4-f17a10d70e19 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.031123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5a5c-0c65-4ee6-a1c4-f17a10d70e19 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.031617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e5a5c-0c65-4ee6-a1c4-f17a10d70e19 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.033449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 222/456] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:47.049684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5908a-2a3c-4d9a-9671-c0c40842fcb9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.050176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5908a-2a3c-4d9a-9671-c0c40842fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.050720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5908a-2a3c-4d9a-9671-c0c40842fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.074941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8be5908a-2a3c-4d9a-9671-c0c40842fcb9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:47.076172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8be5908a-2a3c-4d9a-9671-c0c40842fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:47.162358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 235/457] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:47.187326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5a5c-0c65-4ee6-a1c4-f17a10d70e19 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:47.230687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:47.333622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e5a5c-0c65-4ee6-a1c4-f17a10d70e19 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:47.380742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:47.381551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.381842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.382174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.388528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7693741-d214-48cd-96b8-d7dfd941dbbb None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.388827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7693741-d214-48cd-96b8-d7dfd941dbbb None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.389097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7693741-d214-48cd-96b8-d7dfd941dbbb None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.390498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 236/458] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:47.402297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea615-a1a1-402c-b297-2bb0ef50b5a3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.402959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea615-a1a1-402c-b297-2bb0ef50b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.403459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea615-a1a1-402c-b297-2bb0ef50b5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.405934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:47.409407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:47.433376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a54ea615-a1a1-402c-b297-2bb0ef50b5a3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:47.441913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:47.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:47.443980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:47.443980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:47.443980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:47.443980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:47.445408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a54ea615-a1a1-402c-b297-2bb0ef50b5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:47.445984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 223/459] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:47.451814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:47.531093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 237/460] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:47.532978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7f17-4ea9-4eaa-bf84-007e5df86cf7 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.533532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7f17-4ea9-4eaa-bf84-007e5df86cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.534005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7f17-4ea9-4eaa-bf84-007e5df86cf7 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.539577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 238/461] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:47.541403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69fbc-c6a9-4dfa-90f2-658d2feecfd2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.541962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69fbc-c6a9-4dfa-90f2-658d2feecfd2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.542554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69fbc-c6a9-4dfa-90f2-658d2feecfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.560435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:47.561739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-33e69fbc-c6a9-4dfa-90f2-658d2feecfd2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:47.563360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-33e69fbc-c6a9-4dfa-90f2-658d2feecfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:47.584157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d18d2a-4e88-432a-a4a7-d5bf99361275 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:47.610117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:47.621710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:47.622377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.622663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.622950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.623671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:47.624020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:47.625388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:47.637147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 224/462] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:47.637761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:47.653253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 239/463] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:47.653253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b98d6c-8469-4bb8-bdd3-43187071d14d None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.653253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b98d6c-8469-4bb8-bdd3-43187071d14d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.653253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b98d6c-8469-4bb8-bdd3-43187071d14d None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.653253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 240/464] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:47.653253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b98d6c-8469-4bb8-bdd3-43187071d14d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:47.750421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9c81-a8f1-43f8-83cf-218a055529d6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:47.761485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b98d6c-8469-4bb8-bdd3-43187071d14d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:47.788976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:47.789758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.790200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.790670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.796652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46429c-21ab-4454-8fae-fed2206bcb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:47.797324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46429c-21ab-4454-8fae-fed2206bcb8d None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.797613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46429c-21ab-4454-8fae-fed2206bcb8d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.797894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46429c-21ab-4454-8fae-fed2206bcb8d None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.798590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46429c-21ab-4454-8fae-fed2206bcb8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:47.800075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46429c-21ab-4454-8fae-fed2206bcb8d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:47.802968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:47.804430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:47.806250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:47.831911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 241/465] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:47 2022] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:47.831911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:47.831911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:47.831911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:47.832353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:47.833292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:47.834355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:47.834355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:47.834355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:47.834355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:47.834355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 225/466] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:47.834355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:47.851859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:47.854175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:47.878061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:47.947752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 242/467] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:47.948838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:47.976219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344220-02ee-41ea-ba11-3e9d87024750 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.030395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.032786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.033371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.033781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.049014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.050628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.066818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749f2d-0c38-4a44-b69b-72db8106f020 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:48.072353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:48.073409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:48.074217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:48.074217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:48.074217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:48.074217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:48.074217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 226/468] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:48.074217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.118161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.119671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.120030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.120312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.121036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:48.121356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.122739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.139302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.143440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 243/469] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:48.146520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.164429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.211681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dbf81-6024-4967-876b-ac1911c074a4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.253323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96f23-315e-4483-a94c-ea058d225725 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.257993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.259137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.259810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.260346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.276522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.279130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.293808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.294566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.294921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.295265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.296103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:48.296476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.297925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:48.303532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:48.304412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:48.305270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:48.305270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:48.305270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:48.305270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:48.308117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 227/470] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:48.308919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.313006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 244/471] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:48.314855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.409918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.422419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.426389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb8637-c4e8-4d96-94d9-91a442bdfc1a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.438349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d7018-7863-484d-978e-c5c3a0af01c4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.464154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.464927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.465221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.465499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.466281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.467816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.476814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.478247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.478745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.479337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.480276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:48.480589 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.482166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.491740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 228/472] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:48.493016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.508122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 245/473] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:48.514564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.662271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c4a9-9dda-41b1-a53e-18f38f6a3a2b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.686546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2d562-724c-4f76-b4ee-393912a7be7d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.706762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be3936-f13a-4b42-a228-3035a8bf3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.707445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3936-f13a-4b42-a228-3035a8bf3bc9 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.707731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3936-f13a-4b42-a228-3035a8bf3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.708047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3936-f13a-4b42-a228-3035a8bf3bc9 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.708762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3936-f13a-4b42-a228-3035a8bf3bc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.710212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3936-f13a-4b42-a228-3035a8bf3bc9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.740095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 229/474] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:48.741109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.741965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.742307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.742519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a588fcb-a9a3-471c-ac58-cbd5279f5a8a None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.742706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.743197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a588fcb-a9a3-471c-ac58-cbd5279f5a8a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.743366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.743862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a588fcb-a9a3-471c-ac58-cbd5279f5a8a None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.744964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.745967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 230/475] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:48.752753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.753381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.753847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.754152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.777226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 246/476] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/users => generated 249 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:48.781252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:48.783097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:48.788076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.874074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 231/477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:48.897485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.030159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94e125-fe07-4f32-882b-cce1f0bf3fab None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.078548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.079232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.079515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.079788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.080574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.082028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.090246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.sql.core [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:14:49.090246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:14:49.090246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [parameters: {'id': '4b025e2f533e4672ab6fed20b93930dd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:14:49.090246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86570) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result.read() Jun 16 00:14:49.107462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:14:49.108488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application yield resource Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise self.value Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application session.commit() Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:14:49.109404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:14:49.110241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:14:49.111096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result.read() Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:14:49.111935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [parameters: {'id': '4b025e2f533e4672ab6fed20b93930dd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:49.112710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:14:49.113549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:49.114429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 247/478] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:49.116340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.248871 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d05b6-acef-4778-b56e-73ec25f5854e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.285734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b503e8-f439-4d37-8984-6aaaa0a203fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.286539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b503e8-f439-4d37-8984-6aaaa0a203fc None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.286830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b503e8-f439-4d37-8984-6aaaa0a203fc None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.287109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b503e8-f439-4d37-8984-6aaaa0a203fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.296379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.302797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b503e8-f439-4d37-8984-6aaaa0a203fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-69b503e8-f439-4d37-8984-6aaaa0a203fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:49.314609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:49.315490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:49.316314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 232/479] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:49.323696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.435639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.499684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14b55-33f0-4db6-9510-a33444de874c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.536984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.537576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.537865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.538150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.538905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:49.539217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.540673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692b352-f031-41f8-92b6-f26cc0d52730 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.549617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 248/480] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:50.406148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ff887-8a56-497c-8598-a2d49a8721dd None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.406648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ff887-8a56-497c-8598-a2d49a8721dd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.406648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ff887-8a56-497c-8598-a2d49a8721dd None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.408399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 233/481] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:50.413554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.413955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.414148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.433604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:50.434802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:50.527276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 249/482] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:50.562614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ff887-8a56-497c-8598-a2d49a8721dd None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.712687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ff887-8a56-497c-8598-a2d49a8721dd None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.761949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.763132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.763626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.764130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.780783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:50.788936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:50.789904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:50.791274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:50.794104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 234/483] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:50.799532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.880056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.954476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2fca-a58a-4a3e-b400-29d1ed71444f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.997281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.997956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.998239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.998513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.999259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:50.999561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.000956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdf128-a5b1-4a42-a375-4502f82a96df None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.009689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 250/484] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:51.014988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.113834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.174271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc256f-4e76-4217-a9cc-6e67f6b85650 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.174577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc256f-4e76-4217-a9cc-6e67f6b85650 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.174831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc256f-4e76-4217-a9cc-6e67f6b85650 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.176352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 251/485] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:51.177882 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0761-ebda-4a29-b950-3a709d928123 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.182508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.182797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.183076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.217356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.218151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.218436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.218713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.225063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:51.226311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:51.232866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.234407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:51.256323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:51.257203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:51.258024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:51.258024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:51.258024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:51.258024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:51.258024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 235/486] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:51.265276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.381169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 252/487] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 00:14:51.407034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30af076-17a2-4572-8c98-ddc85abaad95 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.409652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.435909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.462817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.465876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.466801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.466911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.467100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.467836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:51.468272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.469548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.487256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 236/488] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:51.501636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.562590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67727-5619-4d42-8116-26061bd5897b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.632433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e151a5-80e2-49ff-a378-3365c1384eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.633236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e151a5-80e2-49ff-a378-3365c1384eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.633519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e151a5-80e2-49ff-a378-3365c1384eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.633790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e151a5-80e2-49ff-a378-3365c1384eb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.647565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c87a-4760-46e2-aaf0-1f131585fbd7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.647845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e151a5-80e2-49ff-a378-3365c1384eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-56e151a5-80e2-49ff-a378-3365c1384eb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:51.658189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:51.659146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:51.659941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:51.661039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 253/489] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:51.664897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aedef5-2621-46cd-8ef9-3bb4a97631b5 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.665190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aedef5-2621-46cd-8ef9-3bb4a97631b5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.665488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aedef5-2621-46cd-8ef9-3bb4a97631b5 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.667708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 254/490] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:51.668532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aedef5-2621-46cd-8ef9-3bb4a97631b5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.699768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.700765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.701171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.701508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.709810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.711270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-5a4b38a1-61f2-4a68-99ae-57701682f4c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:51.729999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:51.730956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:51.731835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 237/491] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:51.733388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.733724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.734140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.753001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:51.754688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:51.782949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.786423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.789063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aedef5-2621-46cd-8ef9-3bb4a97631b5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.826384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.826990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.827290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.827557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.828336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:51.828652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.830059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d963d3f-c6f2-40b5-b1c6-469d67e7fc03 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.843893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 238/492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:51.843893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.848151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 255/493] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:51.849467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3463-9b1f-484b-bdca-9886b58f58fc None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.849762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3463-9b1f-484b-bdca-9886b58f58fc None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.850104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3463-9b1f-484b-bdca-9886b58f58fc None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.851760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 256/494] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:51.856297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3463-9b1f-484b-bdca-9886b58f58fc None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.950791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1732-3d7d-469e-a9b8-748dab1c08a6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.961322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3463-9b1f-484b-bdca-9886b58f58fc None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.988270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.988951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.989241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.989525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.990367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:51.990683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.992142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204c6b6-8c61-40da-b682-8102bd6b59df None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.997535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.998338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.998626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.998907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.010491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.011989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.035965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 239/495] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:52.036146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:52.037159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:52.038160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:52.038160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:52.038160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:52.038160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:52.038419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.038419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.038557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 257/496] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:52.038633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.038718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.060156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:52.061360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:52.063075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.077477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.133878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 240/497] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:52.135355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.164374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989bd9-1fbf-49be-a201-56c5e99d6500 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.201649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.202448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.202732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.203013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.213667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:52.221466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:52.222365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:52.223161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 258/498] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:52.223843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.252144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022520c-8adb-4682-a7eb-636e103937a3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.289022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.289679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.289964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.290243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.312033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.324531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.355318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d0a1e-acb2-4b09-b939-f2c9561565dc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.373297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.374801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.393252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.393989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.394284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.394568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.395288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:52.395703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.397117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.410168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 259/499] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:52.410958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.474208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 241/500] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:52.475071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.507986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba075-9d43-4f1f-b768-d4a5509eba82 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.526553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.542110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845cdc1-a0a6-4ef5-9c2a-f42520452ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.542907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845cdc1-a0a6-4ef5-9c2a-f42520452ccc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.543198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845cdc1-a0a6-4ef5-9c2a-f42520452ccc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.543476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845cdc1-a0a6-4ef5-9c2a-f42520452ccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.545389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.555382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845cdc1-a0a6-4ef5-9c2a-f42520452ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6845cdc1-a0a6-4ef5-9c2a-f42520452ccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:52.563686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:52.564632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:52.565421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 260/501] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:52.566238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3cbbd-5731-4c3a-a249-17988a4875f2 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.566575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3cbbd-5731-4c3a-a249-17988a4875f2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.566845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3cbbd-5731-4c3a-a249-17988a4875f2 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.568109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 261/502] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:52.568802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3cbbd-5731-4c3a-a249-17988a4875f2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.581174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e485c94-51b7-4c9d-bcdf-6135f972c659 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.616080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.616679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.616972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.617257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.618011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:52.618324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.620383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.628161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 242/503] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:52.628942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.671640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3cbbd-5731-4c3a-a249-17988a4875f2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.704964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.705756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.706041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.706317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.713854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.715308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.726532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace4ed-931b-4dab-a1b4-1ebff381fe57 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:52.730866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:52.731924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:52.732938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 262/504] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:52.733486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.741392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.764306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.765092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.765375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.765692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.777843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.780594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.791822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-3d900bd2-de1c-45c9-817e-e1fe9d176a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:52.800868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:52.801711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:52.802537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:52.802537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:52.802537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:52.802537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:52.802537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 243/505] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:52.803403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.803697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.804083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.820804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:52.822571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:52.840450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca972d1-8586-46ff-b155-22881cc927d8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.873296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:52.873888 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:52.874171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:52.874448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:52.875182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:52.875486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:52.876899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:52.884628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 263/506] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:52.885420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.890503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 244/507] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:52.891377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:52.984137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:52.987337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa30ee-1f89-44c1-98e3-a1d625d17f7e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:52.991219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20da388-d1b5-4756-b98e-c6fd9ea530a4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.004307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.022258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.023049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.023331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.023607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.027757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.028453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.028746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.029036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.029873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:53.030188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.031628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.034848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.036319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.048917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 245/508] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.049695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:53.053948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:53.054927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:53.056358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:53.056358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:53.056358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:53.056358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:53.056358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 264/509] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:53.056358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.153956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0df5e-b4f7-4193-bd91-97a287e6d5db None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.155308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965504-1886-4c57-bcd0-b55e66528dfc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.186795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.187409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.187528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.187734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.188055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.188213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.188496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.188770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.188863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:53.189081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.190448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.199659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.201122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.202165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 246/510] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.202958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.217870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:53.223217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:53.224254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:53.225272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:53.225272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:53.225272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:53.225272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:53.225272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 265/511] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:53.225606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.247243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.306147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d82bb-92f6-4ab3-96a9-eaebfeac5a9a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.325323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95562a09-c2a4-4614-8bcc-bd33612a56ca None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.340315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.341102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.341383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.341667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.352035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.353803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.358027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.358671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.359078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.359365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:53.371791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:53.372690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:53.373531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:53.373531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:53.373531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:53.373531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:53.373531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 247/512] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:53.373789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.431086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.433049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.440256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.454294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.482300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff13993-8a6d-45c3-a594-58fd78a78649 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.515863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.516549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.516837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.517118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.517869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:53.518177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.519547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.531867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 248/513] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.532654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.534279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 266/514] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:53.535110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.637009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd904d20-b9bf-4a41-bf9f-90f3a4a606aa None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.646804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabe087-9da5-4a88-a383-93443712479a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.657206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.671410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.672303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.673007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.673297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.673722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.674563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:53.674993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.676286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.683298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.684063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.684357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.684641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.687412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 267/515] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.688245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.692245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.693724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:53.708800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:53.709654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:53.710495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 249/516] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:53.711423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.798103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7a9b4-f9b0-4aa8-ae87-f0dada349d52 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.821603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed123a-ce9e-4f03-a5e6-beed182c28d9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.832584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.833254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.833541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.833824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.834543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:53.834855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.836263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.847800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 268/517] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.848659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.860799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.861605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.861901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.862185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.870110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.872093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:53.885917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:53.886979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:53.887919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 250/518] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:53.888490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.892155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.936904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.948462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a84af-f3c1-4095-93f8-db8d554040cc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.982239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.983023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.983311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.983597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.992121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf251e5-0213-4449-863e-c750b6c8db40 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.993372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.995365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:54.012662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:54.013527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:54.014346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:54.014346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:54.014346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:54.014346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:54.014346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 269/519] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:54.014630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.030457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.031260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.031548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.031837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.039613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.041699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:54.056367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:54.057268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:54.058149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 251/520] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:54.059283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.108870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.117669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f952b46-036c-4498-a5d3-001694689fa3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.151415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.152354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.152645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.152928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.153712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.154028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.155456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.159062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b07d13-9978-4512-b6c2-b11ad8c38bcd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.161392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.173955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 270/521] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.174769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.194713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.195318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.195615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.195918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.196619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.198312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.217767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 252/522] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:54 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:54.218870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.300884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b0c91-2f61-4ca2-86d1-10083e2cac52 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.338416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbe633-3134-499d-a40c-a20e05a37df0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.342847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.343533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.343817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.344125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.344979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.345288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.346768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.378594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.379521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.379814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.380129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.380864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.381182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.382553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.390535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 271/523] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.391469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.395913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 253/524] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.396556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.407890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.425789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.514539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0818ba-5604-4188-9cf8-9bdf1f945bb8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.516014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2f39-9ebd-4788-9e90-6fa307644b96 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.552490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.553324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.553564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.553848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.554734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.555050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.556608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.557426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.558181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.558363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.558646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.560120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=450a31adc83e4bf0a8b21c86806981a9) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.560120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.561222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.566994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 254/525] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/role_assignments?user.id=450a31adc83e4bf0a8b21c86806981a9&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.567790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.586430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 272/526] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.589103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.730390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.732699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.754569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c974-2bb8-4c5a-88d9-3e90c333cd3e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.777933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c449759-ddf3-463e-81ea-e32a8616f9c2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.803441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.804731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.805414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.806187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.814444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.815241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.815524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.815797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.823396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.824916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:54.841023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:54.841919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:54.842825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 273/527] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:54.843752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.897380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.898899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.970651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627cc97-43d6-4343-8c11-0c76c6ca5879 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.993526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.003268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.013570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.014368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.014753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.015129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.016857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 255/528] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:55.017942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.108339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.109947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.144766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874ef3-55d0-4ab8-b182-0505d8d5846b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.180390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.181059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.181902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.182194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.182984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:55.183405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.184959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.203812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 256/529] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:55.204847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.222377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 274/530] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:55.223264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.259692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.260962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.332339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5b3f1-b286-4a33-a5d4-98c1a229038a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.351352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e36e-02d3-46af-b5f5-345e76a7814b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.377647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.379197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.379487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.379769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.395093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.395830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.396536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.396642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.396826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.397112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.397958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=1b964670153a46e7b5d41c5fae889860) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:55.398277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.400861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.410974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 275/531] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/role_assignments?user.id=1b964670153a46e7b5d41c5fae889860&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:55.411802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:55.425018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:55.426112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:55.426979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:55.426979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:55.426979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:55.426979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:55.426979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 257/532] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:55.432240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.584073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.600628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe1c50-84dc-4e8f-9ae5-fa93dd27a241 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.614100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4211-35d8-4ca9-bb9a-81eee53b4af8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.616304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.665745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.667386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.668029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.668588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.669646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:55.670148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.671829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.674134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.675056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.675349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.675631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.685554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 258/533] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:55.692870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.695790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.697522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:55.727647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:55.729160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:55.729978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:55.729978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:55.729978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:55.729978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:55.737446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 276/534] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:55.744466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.804700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b961bd9-f022-4c09-9237-b36abe7a1277 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.840189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.840914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.841203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.841490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.850262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.851724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:55.867589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:55.868526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:55.869799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 259/535] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:55.874629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.893767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.950754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7076ce-7520-4874-9cee-1909a7e581d6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.981304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bcc28-d6cc-414a-a3c1-21fe0178adc0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:56.019911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.019911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.019911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.019911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.020313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:56.020313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:56.020628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:56.023253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.024155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.024652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.025760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.026943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:56.027452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:56.029054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:56.035949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 260/536] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:56.038833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:56.055306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 277/537] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:56.067493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:56.078796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:56.190179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:56.231169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c7ea-832e-4d2b-adbb-e3727a2c5430 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:56.246601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e8e1-146c-44a0-9ec2-d1f9e70cfb39 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:56.304906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.307387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.309691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.310558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.316628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.320791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.321298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.321796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.323478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=cb15a3e003fb4f0f8f876c5635b6a020) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:56.324044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:56.326024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:56.327089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:56.328779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:56.338654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 261/538] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:56 2022] GET /identity/v3/role_assignments?user.id=cb15a3e003fb4f0f8f876c5635b6a020&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1a0ce9c2-e86b-4ea4-8217-3a59617abe8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:56.361174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:56.362069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:56.362879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:56.363284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 278/539] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:56.368500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:56.457210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8098e-69e4-4d75-a94f-99031c51db8b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.457402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8098e-69e4-4d75-a94f-99031c51db8b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.457680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8098e-69e4-4d75-a94f-99031c51db8b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.459070 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 279/540] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:56.469437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.469742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.469999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.508120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:56.509359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:56.560549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddeca-2f87-4083-b891-b9605ae983b1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:56.609646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.610317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.610603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.610881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.611668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:56.612107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:56.613668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:56.623839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:56.627731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 262/541] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:56.628766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:56.633318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:56.659896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 280/542] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:56.689200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:56.800923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb105-cd5a-49d7-b8e3-a3898be1aaa8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:56.840894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.841570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.841865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.842154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:56.842997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=367573878e1d440594736c21e9a5497b) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:56.843313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:56.845265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ae09-7b47-4c2e-a558-8af217fb62e3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:56.851673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 263/543] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:56 2022] GET /identity/v3/role_assignments?user.id=367573878e1d440594736c21e9a5497b&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:56.927147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b300dd-4cce-4b3f-bc54-86cfd5d0a2c5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:56.986255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:56.987080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:56.987363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:56.987639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.008904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05b2a-097f-4a6d-9328-1802ae4467fa None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.009210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05b2a-097f-4a6d-9328-1802ae4467fa None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.010039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05b2a-097f-4a6d-9328-1802ae4467fa None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.012039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 264/544] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:57.012981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:57.016738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.017245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.017732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:57.021229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:57.022125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:57.022897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:57.027306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 281/545] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:57.028527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.051463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:57.053018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:57.124773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.176611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37405-aaf0-4026-9c42-22564252a0ed None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.215249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.216309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.216806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.217382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.218369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:57.218882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.220567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.221810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.230344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 282/546] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:57.234565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 265/547] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:57.235952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.269426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.412164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1187-59c7-49f7-8d6d-ea479a0b8323 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.441981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.471130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aca35c-8796-40ce-b2b7-e87a8078d4a1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.488581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.489736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.490247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.490734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.510013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.512968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:57.544293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:57.545200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:57.546024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:57.546024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:57.546024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:57.546024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:57.553316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.554425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.554922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.555402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.557061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 283/548] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:57.559374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.579779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:57.587944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:57.588843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:57.590152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:57.605810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 266/549] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:57.608518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.724364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.736675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6c22-d79d-4104-b8a5-b798b5910ff6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.779385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.780096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.780383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.780661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.781676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:57.781992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.783379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.805913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289be8a4-ac00-4e48-96dc-698f652c0bee None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.811990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 284/550] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:57.824509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.876266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.892828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.893512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.893801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.894178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.894838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:57.895150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.896552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10f8d7-0ddc-44df-bbac-b7aa29dd8cf3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.910999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 267/551] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:57.912207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ff94-43f8-4334-bd64-aae7bbef9b56 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.913384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ff94-43f8-4334-bd64-aae7bbef9b56 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.913645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ff94-43f8-4334-bd64-aae7bbef9b56 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.917134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 268/552] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:57.918552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ff94-43f8-4334-bd64-aae7bbef9b56 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.979793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6bcd-eed8-4edc-a3b7-13b4e0ebb3c0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.019493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.020484 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.020687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.020961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.029163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.030735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-13543e44-c50e-4c8b-ae8a-78673c420b21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:58.046794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.047794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:58.049106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 285/553] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:58.049662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.050048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.050048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.050451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ff94-43f8-4334-bd64-aae7bbef9b56 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.068535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:58.069778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:58.071312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.098595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.100430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.100922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.101624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.118299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.121317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:58.145303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.146174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.147118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:58.147118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:58.147118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:58.147118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:58.153956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 286/555] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:58.153956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.154429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 269/555] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:58.155600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.190289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.277104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19316a-09a4-44d7-89f4-e6c38ec0731d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.294774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578a06-f83c-45e3-938b-6b4e3dfcc2cf None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.314689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.315368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.315656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.315975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.316816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:58.317125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.318892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.337060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 287/556] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:58.338240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.339051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.340000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.340556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.341312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.343150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:58.343649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.345251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.367071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 270/557] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:58.367071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.396327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.440064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.471355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7916-738a-4c80-add7-e24cd300de1c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.476045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0edfec-6ece-4336-b7b6-2954b2b89a86 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.513639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.514230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.514350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.514624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.514856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.515802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.516310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.516801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.530317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:58.539172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.540608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:58.541426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:58.545819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 288/558] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:58.546547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.607628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.609403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.637762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.659041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd8b94-63f6-449e-b7bc-72df2c3270ab None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.697059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.698056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.698447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.698797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.701889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.710588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.712287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.716138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 271/559] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:58.717185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:58.729576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.730721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:58.731629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:58.736625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 289/560] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:58.738020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.833176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea0aa8-6ec0-4b01-97e5-ec0269c1e0db None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.857928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8fb6e-06f9-4367-8dab-ccadb7dda092 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.867028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.877461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.878139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.878429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.878711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.879469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:58.879779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.881190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.890047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 272/561] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:58.890847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.902532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.903699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.904187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.904702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.918027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.920174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ccc276f4-4051-412a-840b-26b9881454ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:58.942844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.944015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.944887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:58.944887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:58.944887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:58.944887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:58.945764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 290/562] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:58.946731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a847c-7f82-4ef2-a0b8-7615e6e09a23 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.947028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a847c-7f82-4ef2-a0b8-7615e6e09a23 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.948088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a847c-7f82-4ef2-a0b8-7615e6e09a23 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.949432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 291/563] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:58.954017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a847c-7f82-4ef2-a0b8-7615e6e09a23 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.000553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61772df-8eab-4637-8939-e8da969f7be0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.010466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.040312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.041540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.041828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.042104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.042953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.043260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.044752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.070128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 273/564] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:59.075762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.077505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a847c-7f82-4ef2-a0b8-7615e6e09a23 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.117914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.118631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.118971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.119246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.131201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.131580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.132701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-dedaeb1a-9fe1-41c9-baa7-825abaad6332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:59.151552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.152573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 292/565] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.158033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.173334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:59.174554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:59.191674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b435d-fc40-457a-9c75-a6b30f29eec1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.230578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.231256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.231549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.231833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.232602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.232916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.234300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.245818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 274/566] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:59.246631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.252492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 293/567] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:59.253317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.282916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.350557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc0a1-ecb9-46fd-8e29-0a7941cc8169 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.351424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964910d-a7c6-4863-baba-5000538f0809 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.360414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.385100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.386016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.386305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.386586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.386802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.387463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.387751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.388065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.388784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.389091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.390458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490dd6f-c944-43d3-abbc-e2612fa85d85 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.397267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.398684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.402146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 294/568] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:59.403383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77043e0-0ac6-4b09-afd8-c2accae3b3b0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.403675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77043e0-0ac6-4b09-afd8-c2accae3b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.404051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77043e0-0ac6-4b09-afd8-c2accae3b3b0 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.405429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 295/569] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:59.406011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77043e0-0ac6-4b09-afd8-c2accae3b3b0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:59.417708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.418703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.419574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:59.419574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:59.419574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:59.419574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:59.419574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 275/570] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:59.419863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.506341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.517779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77043e0-0ac6-4b09-afd8-c2accae3b3b0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.520042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1059ee-2f10-4c88-9785-fb17f39fa6b6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.551302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.552156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.552442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.552719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.553974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7434c5-a577-4eec-ad7c-33aae7a19470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.554759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7434c5-a577-4eec-ad7c-33aae7a19470 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.555045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7434c5-a577-4eec-ad7c-33aae7a19470 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.555326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7434c5-a577-4eec-ad7c-33aae7a19470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.559423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.560916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.565416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7434c5-a577-4eec-ad7c-33aae7a19470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-0e7434c5-a577-4eec-ad7c-33aae7a19470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:59.573104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.574021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:14:59.574847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 276/571] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:59.575530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:59.576107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.580674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:59.581871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:59.582376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.582376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.582512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 296/572] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:59.582512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.594462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:59.595656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:59.610616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.663344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 277/573] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:59.664418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.681961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cc0b6-4c57-4cbb-8560-c84549139c44 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.716343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.717139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.717424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.717704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] PATH_INFO: `/v3/users/glance` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.724664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.726112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:59.741280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.742825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 297/574] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:59.744749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.756714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.776039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cac9bc-2769-4769-9892-a1a65b1c0db2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.809702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.810359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.810646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.810922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.811636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.811965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.813348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.824327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 278/575] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:59.825114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.836763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.848187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47383b1b-7e12-4d4e-94fe-543e8fd6c67f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.883725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.884418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.884929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.885230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.885975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.886283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.887649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.895349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 298/576] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:59.896335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.926707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d6e4-a6b4-4b7a-ba1a-035507c3aef1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.960269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.960927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.961213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.961490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.962277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.963283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.964853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.967388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.977821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 279/577] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:59.978696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.998765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdd0cc-29b5-45c1-befc-552390125a96 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.032488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.033289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.033575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.033861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.044333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:00.047185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:00.052354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:00.053422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:00.054253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 299/578] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:00.054942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.081773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee91f-0f0c-47b9-b85a-00c1f5d7e6e7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.118113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.118847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.119201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.119489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.120365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.120686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.122109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.139830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 280/579] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.140675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.156937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5063ca-646f-4a1c-b12b-c9b1a3a59f84 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.185221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.190303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.191103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.191395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.191680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.198940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.200436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:00.215039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:00.215979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:00.216880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:00.220010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 300/580] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:00.221305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.239018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1874d5-07d7-4c29-a2b2-b3cbb1a2b84d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.266130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.274324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.275160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.275479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.275822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.285821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.287288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:00.304423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:00.305506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:00.307306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:00.307306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:00.307306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:00.307306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:00.307306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 281/581] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:00.307306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.323551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e70f20-14e6-414c-a8d0-14520e5f8ca3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.357704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.358363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.358647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.358929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.359767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=0f7484f9ef764101977c9da152a7ab75) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.360147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.361578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.366963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 301/582] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/role_assignments?user.id=0f7484f9ef764101977c9da152a7ab75&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.367740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.425229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41be60e-ec83-418c-b0f5-bd30cb2fab58 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.430305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.465569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.466171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.466460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.466741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.467628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.467974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.469388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.483676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 282/583] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.483676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.484036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a709cd-e628-4179-8028-fd1d3b4ab3c9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.521154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.521961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.522248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.522528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.532859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.534674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.536238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:00.555437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:00.556618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:00.557804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:00.557804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:00.557804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:00.557804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:00.557804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 302/584] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:00.558409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.600766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbba3-8d81-4e1b-80f8-2dfc2e98ebe0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.637854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.638812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.639106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.639391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.640226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.640540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.642074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.659613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 283/585] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.659613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.670374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2b4a-9a36-43e7-a953-b92aa1dfc3e7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.681882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.711347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.712262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.713222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.713531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.714260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.714570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.716018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.733580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 303/586] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.733580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.769054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249218d9-c90b-4eee-afee-2a848664830d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.771157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.807888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.808810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.809162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.809450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.820016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.821451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:00.841979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:00.843512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:00.844414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:00.844414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:00.844414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:00.844414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:00.844414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 284/587] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:00.844414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.850370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b97cc4-d9a8-4f83-8c4a-69135b9585e6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.887038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.887925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.888321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.888739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.889600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.890429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.892311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.909871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 304/588] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.909871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.936185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.958946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076babb2-ab72-4253-991d-bc0427c81899 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.997509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.998403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.998684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.998960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/450a31adc83e4bf0a8b21c86806981a9/roles/761beeab640c4d539743da31146304a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.012385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbe299-7f78-49a6-ae6a-b7b67a9cce45 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.014600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=450a31adc83e4bf0a8b21c86806981a9, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.016076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.039913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 285/589] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:00 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/450a31adc83e4bf0a8b21c86806981a9/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:01.039913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.044621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.075768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.077949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.078530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.080073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.091255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.093015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:01.112238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:01.113463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:15:01.114669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:01.121171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 305/590] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:01.121171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.189302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127ddc-3b53-4986-9277-9c28720349ec None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.232101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.235588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.236294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.236581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.236860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.238046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:01.238046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.239415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.250638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ad371-c68c-48a4-b493-e350194e6f2c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.255661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 286/591] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:01.255661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.289196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.290189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.291074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.291510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.299753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.301423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:01.315844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:01.316914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:01.317977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:01.319884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 306/592] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:01.320736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.334615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.389090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2f52-af1f-43b5-80f0-d6e44c47fcb3 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.429139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.430059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.430483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.430905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.432247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:01.432725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.434301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.437813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3041e2-6f8b-4d41-949e-c503253c5d4a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.458839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 287/593] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:01.460145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.476789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.477694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.478608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.479017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.487304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.488931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:01.505839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:01.506970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:15:01.508126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:01.513779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 307/594] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:01.513779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.522856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.581178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3874e-e037-4776-9950-636dbf0041b4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.609106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.622413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.623287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.623716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.624203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.625158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:01.625606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8a883-24b4-49cd-9c5e-4381ceada84f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.625781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.627360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.640414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 288/595] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:01.641529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.669557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.670549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.670974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.671351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.684077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.685690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:01.705956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:01.707092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:01.708219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:01.708219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:01.708219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:01.708219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:01.709324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 308/596] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:01.710203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.755218 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735951c-2fad-4e90-9ecf-4e3b3cce230d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.778733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.795111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.796089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.796526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.796956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.797960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:01.798435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.800064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.823903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 289/597] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:01.824992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.830216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8846-31be-4b3e-8984-b25c9d92e7d8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.866979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.868090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.868481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.869398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/1b964670153a46e7b5d41c5fae889860/roles/761beeab640c4d539743da31146304a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.870729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:01.889514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=1b964670153a46e7b5d41c5fae889860, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.891335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.912149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 309/598] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:01 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/1b964670153a46e7b5d41c5fae889860/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:01.913604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:01.943909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b1f1e-51bb-4910-9122-bcb0ba9da89c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:01.976510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:01.977150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:01.977386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:01.977919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:01.979825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:01.980189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:01.981556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:01.995637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 290/599] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.004977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.106575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34268a14-b3ba-4147-8653-f33b799e1dd4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.127602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.133814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a2ed2-1d71-45a6-acff-0d75442e0f9a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.137069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.169770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.170975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.172410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.172944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.199480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.202358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:02.229085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:02.230236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:02.231095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:02.231095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:02.231095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:02.231095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:02.231313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.231313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.231313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.231313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.235066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 310/600] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:02.240838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.249230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.250715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:02.274133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:02.275717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:02.276631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:02.278726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 291/601] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:02.286451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.376621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9687ba-5790-404e-b3f5-44f065f0e02d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.413569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.414625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.415144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.415697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.416668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:02.417197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.418786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.432853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 311/602] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.438354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.464487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.549357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531647b-5993-4616-abe9-afd9f30e8eba None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.552232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab14b8-5973-4381-b32a-8747b41d0e25 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.588137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.589336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.589838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.590388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.598529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.599572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.600266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.600553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.600830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.601326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.601624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:02.601934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.604441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2caa5-ee07-4f03-a8c7-b2978b29af39 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.617784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 292/603] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6fb699c9-181b-4e14-ba11-3785050169f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:02.619449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:02.620730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:02.621640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:02.622080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66a2b1-8cef-4e04-b0ca-8f9786a42aaf None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.622080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66a2b1-8cef-4e04-b0ca-8f9786a42aaf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.622080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66a2b1-8cef-4e04-b0ca-8f9786a42aaf None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.622080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 293/604] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:02.625111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 312/605] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:02.629419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66a2b1-8cef-4e04-b0ca-8f9786a42aaf None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.629543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.629543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.629856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.650069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:02.651476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:02.656156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.740021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 313/606] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:02.741242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.753788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66a2b1-8cef-4e04-b0ca-8f9786a42aaf None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.770507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.799165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.800084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.800367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.800641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/cb15a3e003fb4f0f8f876c5635b6a020/roles/761beeab640c4d539743da31146304a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.816304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=cb15a3e003fb4f0f8f876c5635b6a020, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.817752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.834288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 294/607] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:02 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/cb15a3e003fb4f0f8f876c5635b6a020/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:02.835238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.895001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2994-f946-4af2-8247-010a106368eb None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.918949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.953488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.954660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.955510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.955977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.957167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:02.957633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.958431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536ac20-1a11-40cb-b659-8353587a17f6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.959392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.977387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 314/608] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.985149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.023708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.024554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.024838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.025278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.038075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:03.052334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:03.053262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:03.054190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 295/609] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:03.064443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.123420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.168200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63bfa-2e54-4bf2-8f8f-0c14d60f9498 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.194920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d046e37-b3ef-4319-bc77-d66023f2cce7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.211718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.213646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.214032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.214417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/367573878e1d440594736c21e9a5497b/roles/761beeab640c4d539743da31146304a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.231344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=367573878e1d440594736c21e9a5497b, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.233152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.241003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.251442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 315/610] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:02 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/367573878e1d440594736c21e9a5497b/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:03.253257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.254044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.254445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.254807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.255661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:03.256084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.257700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.269271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 296/611] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:03.276905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.423363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e843b-2580-48d5-8216-982780af2b19 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.454268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.471420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.472294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.472585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.472870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.488784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.490271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-63759aa0-46a3-4c87-83ad-3fcb0f0e9391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:03.517196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:03.518129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:03.519001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:03.519001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:03.519001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:03.519001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:03.519001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 316/612] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:03.525937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.532731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911497f8-4f50-424c-9c41-5cacc6aa27a1 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.533024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911497f8-4f50-424c-9c41-5cacc6aa27a1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.533296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911497f8-4f50-424c-9c41-5cacc6aa27a1 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.534927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 317/613] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:03.541108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.541404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.541686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.559934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:03.561122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:03.674601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 318/614] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:15:03.676279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae369f-d1b4-4fc6-ab8a-727cb53079f9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.711257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.712386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.713544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.714084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.714575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.715552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:03.716147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.717726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.736276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 297/615] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:03.738198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.800415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.854277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c722-43b1-4214-aa75-1ef0f1cdb884 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.892678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.894044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.894566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.895054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.903969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.906164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:03.922663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:03.924111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:03.925078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:03.932212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 298/616] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:03.935044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.013372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9aaeb-010e-49d4-be8f-e8bf4ef20f55 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.015940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.047675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706440-6251-49ea-8dbb-94c5559a8a8f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.081877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.085737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.086629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.087277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.088313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.089711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.090240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.092098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.112769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 299/617] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:04.118028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.132588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.133412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.133705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.134047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.170260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:04.178282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:04.179169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:04.180035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:04.185158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 319/618] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:04.194512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.227057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f27c-ca71-4733-a6cd-097eb021c21b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.269706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.270942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.271365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.271661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.284026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.285496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:04.315668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:04.316662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:04.317694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:04.317694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:04.317694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:04.317694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:04.317694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 300/619] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:04.323108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.372259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.435223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637dc62-4de7-420c-882a-ec06886b58f2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.473920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.474625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.474916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.475201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.475957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.476273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.478418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.491636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 301/620] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:04.498174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.554289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378feeb-b307-417e-bd60-dcfe280fdcb1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.606365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.615759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.616632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.617223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.617523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.618562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.619487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.621306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c0ed6-3c32-4e1d-8cd5-d102115f70b7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.626563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa261cb-1a8c-49f5-9ff5-b33cf2af872e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.631967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 320/621] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:04.633299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a129a2-ac87-4782-be53-3aa400f07d32 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.633592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a129a2-ac87-4782-be53-3aa400f07d32 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.634337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a129a2-ac87-4782-be53-3aa400f07d32 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.636403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 321/622] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:04.638772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a129a2-ac87-4782-be53-3aa400f07d32 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.666828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.667748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.668136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.668491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.673116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.676314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.677822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-74860390-81b3-479a-9acf-835405d4fc51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:04.696288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:04.698265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:04.699351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:04.703036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 302/623] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:04.704633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.704879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.705166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.723474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:04.724703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:04.772901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a129a2-ac87-4782-be53-3aa400f07d32 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.808308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 303/624] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:04.809370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.815161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.816203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.816669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.818029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.832733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.834449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:04.856351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:04.857456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:04.858540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:04.858540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:04.858540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:04.858540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:04.860830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 322/625] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:04.862343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.909154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.944598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d4265-783a-4432-a2e8-b8da6e44ad66 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.964337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.985845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.986705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.987096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.987473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.988527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.988913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.990615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.992751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac81109-65f1-4bec-b77e-4cdc7fba8d06 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.008839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 304/626] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:05.010612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.037530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.039127 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.039618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.040205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.054682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:05.064139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:05.065110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:05.065945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:05.070455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 323/627] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:05.071455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.136110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005011-c44b-4dfd-92c0-e4cc64c90616 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.173082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.179683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.180919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.181483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.182343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.183255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:05.183758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.184333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73b5db-fabd-4c4c-a3f7-b46921186cea None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.185546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.205414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 305/628] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:05.205414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.233473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.235166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.235627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.236078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/0f7484f9ef764101977c9da152a7ab75/roles/761beeab640c4d539743da31146304a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.247216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.254961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=0f7484f9ef764101977c9da152a7ab75, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.256467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.275960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 324/629] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:05 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/0f7484f9ef764101977c9da152a7ab75/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:05.275960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.372197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2680b2-0a14-492e-ae55-a01157afc9fe None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.406591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93fe75-8e64-46dc-a503-ecf4a4dcd185 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.421907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.422975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.423597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.423972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.424974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:05.425352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.427522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092950ec-d7d5-4b1e-853d-080338b24c12 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.439633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 306/630] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:05.441597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a98254-a442-4643-813f-517d7bae14f0 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.441997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a98254-a442-4643-813f-517d7bae14f0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.442438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a98254-a442-4643-813f-517d7bae14f0 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.448063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 307/631] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:05.449440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a98254-a442-4643-813f-517d7bae14f0 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.458629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.459447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.459734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.460065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.470428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.472133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9d03f539-53db-479f-b8f1-430074909a5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:05.492760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:05.494400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:05.495314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 325/632] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:05.496665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.496964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.497245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.518704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:05.520196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:05.533028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.579115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.588352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a98254-a442-4643-813f-517d7bae14f0 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.612805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 326/633] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:05.615938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.643633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.644514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.644804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.645944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.659699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.660996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:05.679339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:05.680281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:05.681224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:05.681224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:05.681224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:05.681224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:05.681224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 308/634] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:05.682038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.753945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ec1a8-04f7-4d98-9eb8-250ce8ac13e2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.793031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.794027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.794241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.794526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.795362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:05.795959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.797153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.815638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd0eeb-5c38-4483-8474-cabdd5e4ace3 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.820645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 327/635] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:05.822389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.833344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.871227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.871967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.872149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.872405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.872687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.886454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:05.897161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:05.898125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:05.898945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:05.904022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 309/636] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:05.905332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.952467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8753d-3bc3-4b71-b085-3b5826121a75 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.986768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.987430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.987715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.988027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.988749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:05.989059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.990423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.006554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 328/637] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:06.006554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.020329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949c319-bfb8-49e4-8019-f8f81bff550e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.061052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.061909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.062350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.062806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.099535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.109291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.115865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a68c2c-0273-44a8-a344-448a77a620c5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.138561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.140073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.149422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.150775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.151062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.151342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.152133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:06.152443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.153812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e8dc8-a2c3-487c-afc0-49336bb9c01b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.162421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 329/638] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:06.165278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c224a-7258-4e5d-86d0-d13305f45656 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.165616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c224a-7258-4e5d-86d0-d13305f45656 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.165919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c224a-7258-4e5d-86d0-d13305f45656 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.167245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 330/639] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:06.168054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c224a-7258-4e5d-86d0-d13305f45656 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.251678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 310/640] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:06.252637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.276397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c224a-7258-4e5d-86d0-d13305f45656 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.312805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.313601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.313900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.314179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.321641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.323166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.327288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-04dd8eef-e44e-4af4-ad1a-9deee36c53f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:06.337174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:06.338967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 331/641] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:06.340762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.341443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.341443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.358081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:06.359272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:06.374665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.377412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b467-578e-4b9f-af50-270c94ffee4d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.415027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.416589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.416888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.417169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.427979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.429425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.430975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 332/642] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:06.431757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:06.457175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:06.458393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:06.459523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:06.459523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:06.459523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:06.459523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:06.460341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 311/643] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:06.461019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.550761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e96fdd-61a8-427d-aced-d44a0cddf139 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.568771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbac4-f19c-4f6e-9e78-caa1180fb02c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.587187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.587788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.588703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.588994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.589277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.600621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.602083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.607774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.608478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.608775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.609059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.609912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:06.610226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.611646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.612278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:06.622719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:06.623580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:06.629286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:06.629286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:06.629286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:06.629286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:06.629286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 333/644] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:06.629286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.638490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 312/645] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:06.638490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.734375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d7d27-148e-4da5-829a-4c4ab4110a06 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.744474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977408e-308d-4f44-bf6f-003b4856430a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.769608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.770532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.771012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.771451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.781195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.781862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.782156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.782437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.782863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:06.783157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:06.783467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.784857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:06.790533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:06.792117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:06.792987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 334/646] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:06.794336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.801876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 313/647] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:06.802631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.839619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.858627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.903076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd493311-0312-4c83-b5d2-7e58e0686426 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.912305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3a2c-ae6e-4459-bc94-1db3f7c582e2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.939387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96379411-9449-4291-9fca-b52463e52764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.940378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96379411-9449-4291-9fca-b52463e52764 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.940835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96379411-9449-4291-9fca-b52463e52764 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.941231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96379411-9449-4291-9fca-b52463e52764 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.942033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96379411-9449-4291-9fca-b52463e52764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:06.942557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96379411-9449-4291-9fca-b52463e52764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:06.944439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96379411-9449-4291-9fca-b52463e52764 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:06.948780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.949467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.949755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.950034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.963967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 335/648] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:06.963967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96379411-9449-4291-9fca-b52463e52764 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.028772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.030819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.067368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96379411-9449-4291-9fca-b52463e52764 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.077899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.090098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.106652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.107529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.108018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.108459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.109350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.110252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.111762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.123274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 336/649] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.124548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.148724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 314/650] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:07.150575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.244786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8a2c-33fc-4ad3-9e48-58a928d80545 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.260049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ff097-e0c1-4a05-b589-026360738715 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.279961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.280858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.281212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.281565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.289849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.291428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.295588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.296501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.296857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.297203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.300012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.305493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:07.306219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.307904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:15:07.309053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:07.309587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.313811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 337/651] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.314619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:07.325077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.326145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 315/652] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.332216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.367193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.426395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e514-a7d8-4855-a6d1-db238aca0259 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.438581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3416c7-3821-43b1-887e-c0e713d16d63 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.469295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.470104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.470387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.470663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.478784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.479590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.479900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.480187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.483279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.484768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.490863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.492414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:07.502800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.503682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.505229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:07.505229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:07.505229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.505229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:07.505229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 338/653] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.505229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:07.515101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.516147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.517020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:07.517020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:07.517020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.517020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:07.517020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 316/654] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.517932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.567690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.602878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.610571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1bd05-b622-4b3d-b97b-f3f9ef43becf None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.621551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90518d-765a-4c1b-b71b-c0693fefcf6c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.643238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.643947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.644235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.644515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.645349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.645663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.647100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.654865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.655527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.655819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.656135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.656927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.657237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.658660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32959-81aa-41ef-a052-5ac1523e0fb8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.664654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 339/655] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.665465 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.671163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 317/656] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.672371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b4b-fc38-4d60-9035-3a1c86876570 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.672662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b4b-fc38-4d60-9035-3a1c86876570 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.672944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b1b4b-fc38-4d60-9035-3a1c86876570 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.674171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 318/657] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:07.674864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b1b4b-fc38-4d60-9035-3a1c86876570 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.766595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b31f6-fa79-439c-94e6-c144c98472c6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.779233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b1b4b-fc38-4d60-9035-3a1c86876570 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.788823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.805731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.806508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.806965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.807244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.808000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.808310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.809675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.814449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.815115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.815405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.815687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.816433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.816746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.818087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.820573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 340/658] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.821346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.833859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 319/659] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.833859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.837181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.921037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f4560-4534-4048-abde-9d7c1f2ccb9e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.931044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9487b-e857-487f-a31b-b7d81da8a0be None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.954611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.955257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.955544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.955821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.966485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.967142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.967432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.967741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.968639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=450a31adc83e4bf0a8b21c86806981a9) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.968957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.970386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7035413-7af3-49d4-ae8f-25536b6ba37d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.976204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 320/660] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/role_assignments?user.id=450a31adc83e4bf0a8b21c86806981a9&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.977444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.977999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.978310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.996994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:07.998391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:08.028134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.029616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.030096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.050782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.082885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 321/661] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:08.083945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.160076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 341/662] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:08.161104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.215545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3791-9720-49ef-aa6c-37238e81e0df None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.254074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.254883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.255174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.255454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.264305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.265768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.272128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121653f-e471-4d8e-8aed-bf335a299db5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:08.281725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:08.282690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:08.283632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 322/663] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:08.284273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.288883 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.312614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.313303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.313415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.313689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.313975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.320760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.322286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:08.336278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:08.337246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:08.338684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 342/664] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:08.339827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.399369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0484442-7384-4d8e-bd70-864b7b46239f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.439748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.440573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.440858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.441140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.447482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c1376-1d76-44ff-a3d9-1069f1cd0ef5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.452157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:08.459796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:08.460922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 323/665] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:08.461781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.488440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.489156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.489442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.489722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.507095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.509196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:08.533714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:08.534654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:08.535541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:08.535541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:08.535541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:08.535541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:08.535541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 343/666] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:08.535818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.558800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.567169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.580141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c469d-8846-4380-88c9-a77b2e7fee67 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.615910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.616600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.616890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.617169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.618011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.618967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.619781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.643162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 324/667] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.644072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.648609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe150b-73a6-4f6e-92b5-212428e7fe01 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.684540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.685214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.685508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.685794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.686578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.686891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.688358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.701867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 344/668] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.702694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.763054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f7578-35b6-4f31-a35f-7726e8696de5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.799581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.800279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.800572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.800857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.801614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.801929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.803294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.808183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.818565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 325/669] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.818565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.819487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.825738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5d46-5bab-4da9-9b1d-1f76775f8165 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.862564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.863231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.863515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.863795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.864545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.864849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.866214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.878192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 345/670] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.879013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.928885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fbcd9-afe2-465d-852c-38bacb81dc9c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.964619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.965565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.965565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.965818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.985022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55321694-19ae-4d5a-9933-fa07edf2f878 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.019132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.019714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.020043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.020328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.021157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=1b964670153a46e7b5d41c5fae889860) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:09.021693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.022894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.029621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 346/671] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/role_assignments?user.id=1b964670153a46e7b5d41c5fae889860&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:09.030325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.046641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.048192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.050690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.064298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.178933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae53ec-e884-426d-8c0f-adf7a39da82d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.193639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 326/672] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:09.194851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.225165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.226366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.226826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.227249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.242803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.246068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:09.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:09.269561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:09.270512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:09.270512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:09.270512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:09.270512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:09.270512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 347/673] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:09.270856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.321936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb96ae7-194b-4c78-8d42-f50b46ca8479 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.324010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.348669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.377511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.378547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.378839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.379120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.389085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.391473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.396619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8c8ba-9d1b-4b2e-bf45-4a3bc50302f1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:09.408880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:09.409792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:09.410663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:09.411651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 327/674] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:09.412288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.437030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.437844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.438287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.438395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.451444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.452920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:09.470300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:09.471511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:09.472417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:09.472417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:09.472417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:09.472417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:09.472417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 348/675] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:09.473107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.545894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc325df-8a67-4765-8ea9-b99df86e397f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.579292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b0c98-0372-4e95-aa59-228dbf1550c3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.585219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.586148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.586737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.587216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.588740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:09.589272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.590989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.593967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.607114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 328/676] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:09.608407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.617091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.617941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.618054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.618326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.619145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:09.619442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.621180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.634042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 349/677] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:09.635980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.636918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.722090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027098f-62f4-4acb-9e4f-7701fb8a906f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.741812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bbbf1-41fb-4b31-bd4e-1d9545b13ba0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.760448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.761890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.762397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.762889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.763817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:09.764347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.765997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.779735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 329/678] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:09.780591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.781159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.781583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.781906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.782162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.790190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.791838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:09.808894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:09.809836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:09.810747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 350/679] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:09.811354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.850820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.873985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:09.894722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96fff-7142-4f76-b14c-86bfbcd9bf76 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.932110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.933125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.933258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.933604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.934512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=cb15a3e003fb4f0f8f876c5635b6a020) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:09.934950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.936860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.939660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4684-d137-4849-89b6-3127194870d3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.952317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 330/680] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/role_assignments?user.id=cb15a3e003fb4f0f8f876c5635b6a020&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:09.953357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.981829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.983035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.983523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.984035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.992003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.994584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:10.009793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:10.010758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:10.011743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:10.014303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 351/681] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:10.025549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.154976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.163093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc92f-e4ae-4f91-aba1-9d1667680657 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.168339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9806d-b7d9-4bdd-8864-b1fde7e1955b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.212017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.212831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.213469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.213765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.214051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.214427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.214910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:10.215144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.215245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:10.215715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.216736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:10.216858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:10.217369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:10.219158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:10.234132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 352/682] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:10.239731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.243433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 331/683] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 00:15:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:10.249660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.255404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.388000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cae65-b169-4e04-9b5b-980e6b447445 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.392734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07dc3-3e48-4244-b35d-d8ab4bfba9da None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.424320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.424965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.425257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.425587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.426443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=367573878e1d440594736c21e9a5497b) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:10.426748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:10.428220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397484c0-eda4-4e58-a213-e64eedaba34b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:10.433306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.434224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.434716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.435039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 353/684] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/role_assignments?user.id=367573878e1d440594736c21e9a5497b&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:10.435439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.436344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a0cf9-aa01-4c2b-a7f3-9b8c18e3603a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.436635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a0cf9-aa01-4c2b-a7f3-9b8c18e3603a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.436923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a0cf9-aa01-4c2b-a7f3-9b8c18e3603a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.438174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 354/685] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:10.443583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.443907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.444186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.504993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:10.506206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:10.515160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:10.517054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:10.536359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.537732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.625293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 355/686] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:15:10.653302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.671091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 332/687] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:10.677086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.800342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9d46c-7c87-448f-9a90-689944531d11 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.809091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70010-e20e-4088-9890-75a496f5b0db None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.811531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.842622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.843531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.843823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.844133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.848199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.849153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.849584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.849930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.856450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:10.862382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:10.864044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:10.864798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:10.865686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:10.866534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 356/688] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:10.872722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.882506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:10.887472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:10.889507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:10.890990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:10.890990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:10.890990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:10.890990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:10.890990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 333/689] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:10.895713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.032202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fbeae-fd57-46c2-843d-847ee05db48d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.065162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0e39a-4728-4f54-854b-530234fe357b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.105831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.106882 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.107406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.107921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.109243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.109919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.111657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.124594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.125378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.125563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.125969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.126182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 334/690] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.126770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.127089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.131912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.132954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.143565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 357/691] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:11.148943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.173417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.260848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.318964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4b364-5e83-46fc-a34a-9f675c5c51a8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.325511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71598-38bf-484a-beaa-3028a1a5097c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.383994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.385448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.385894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.386326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.390337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.392279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.396910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.397406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.408403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.409373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.410996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.412630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:11.443822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:11.445044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:11.446163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:11.448454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 335/692] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:11.450521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:11.451564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:11.452776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:11.452776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:11.452776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:11.452776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:11.453904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.458241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 358/693] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:11.461550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.575613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.607293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f585c-fc3c-4d63-ae25-a73e3c3ef6c2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.613220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681917-40cc-4804-8487-3ef38e56d38e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.634035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.647486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.648391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.648691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.648976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.649637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.649771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.650792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.651317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.651769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.652222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.652335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f80710-8735-47c4-87c0-4b08527cec3e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.653186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.653647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.655166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.666255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 336/694] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.667641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053179dd-8f6f-469f-a1a9-45bc1513464b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.667966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053179dd-8f6f-469f-a1a9-45bc1513464b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.668259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053179dd-8f6f-469f-a1a9-45bc1513464b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.669511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 359/695] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.679666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 337/696] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:11.679828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.679938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.679938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.679938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.698703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:11.700164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:11.782475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 338/697] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:11.783669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.818324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a86e6-0778-4fe4-9c65-22fff14fcbed None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.861500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.862628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.863139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.863597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.871713 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.873421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.880128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:11.892685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:11.893683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:11.894645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:11.902108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 360/698] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:11.903251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.924768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73d31-6856-493f-b000-2ba56b7f2773 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.955814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.963769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.964775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.965216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.965672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.966662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=0f7484f9ef764101977c9da152a7ab75) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.967130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.968755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.981476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 339/699] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/role_assignments?user.id=0f7484f9ef764101977c9da152a7ab75&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.982835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.029936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3103c84-04fc-4464-8869-8b3cea6a72a2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.092607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.093426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.093709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.093982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.110212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.112309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:12.133079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:12.134050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:12.135665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:12.135665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:12.135665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:12.135665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:12.135665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 361/700] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:12.140651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.256518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.262793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f0ff-9c53-40c4-9c08-40556ff828e3 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.268807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796a30-df4d-4f8e-ac7d-022554044d49 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.302069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.311173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.312105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.312523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.312880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.313826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:12.314266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.316022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.316199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.317031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.317458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.317873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.318901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:12.324204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.326058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.340138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 340/701] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:12.341594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 362/702] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:12.345845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.347120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.463823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be93a3-5560-4838-8335-f93a185ee5cb None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.481460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d960cf-df28-4b3f-a011-1a7c43968a31 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.516445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.517301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.517663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.518509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.533563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ebd0-256b-44d9-a933-18e8727201c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.534242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ebd0-256b-44d9-a933-18e8727201c8 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.534525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ebd0-256b-44d9-a933-18e8727201c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.534800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ebd0-256b-44d9-a933-18e8727201c8 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.535513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ebd0-256b-44d9-a933-18e8727201c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.536972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ebd0-256b-44d9-a933-18e8727201c8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.562086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 363/703] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:15:12 2022] POST /identity/v3/users => generated 254 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:12.564093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da46d1-a11a-42a6-83ef-7953ed53aae4 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.564093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da46d1-a11a-42a6-83ef-7953ed53aae4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.567980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da46d1-a11a-42a6-83ef-7953ed53aae4 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.570391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 364/704] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:12.577494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.577819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.578092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.599768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:12.601039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:12.604537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.612935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.628948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.630461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.693136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 365/705] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:12.717647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.752069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 341/706] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:12.757942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.834320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277dde6-fc8a-4c14-b5e6-b6b478481e5b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.858000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.873092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e59d5-c74d-4106-8f4c-c294ab21e143 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.875626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.876608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.876900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.877184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.877907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.879295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:12.896814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:12.897938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:12.898805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:12.901705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 366/707] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:12.904804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.912273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.913081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.913369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.913650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.920238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.925234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.926710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:12.951153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:12.952169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:12.953075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:12.953075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:12.953075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:12.953075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:12.953075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 342/708] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:12.964461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.025633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e6ab1-bce4-41dd-a80a-2b5ecca546e2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.067915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.067915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.067915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.067915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.068333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] RBAC: Adding query filter params (name=network) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:13.068637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.070220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.079596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93c3b5-5b38-4e7b-a690-17f33bd7e943 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.081491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 367/709] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:13.082949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.121426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.122104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.122393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.122675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.123402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:13.123711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.125304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.135686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:13.139904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 343/710] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:13.146493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.160669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:13.200165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df101-d2e5-4d1a-be29-d40bad06ffcb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.237395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.238069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.238359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.238645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.239913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] RBAC: Adding query filter params (type=network) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:13.239913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.241060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0575537-48e1-4881-a2f2-dad429962242 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.252025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 368/711] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:13.253615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd6569-78bc-4643-9758-16fee7ec65dd None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.253858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd6569-78bc-4643-9758-16fee7ec65dd None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.254148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd6569-78bc-4643-9758-16fee7ec65dd None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.260216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 369/712] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:13.265731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.265731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.266030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.275805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bae2fc-81e4-4e8d-8d3f-d232ed6a442a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.309162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:13.310153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:13.318956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.320074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.320520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.320942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.330727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.332553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:13.350320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:13.351453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:13.352644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:13.356336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 344/713] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:13.362757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.448394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:13.482092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e904a-0b39-45b4-8fc7-620f68311a99 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.523801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 370/714] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:13.528586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.529200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.529486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.529766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.530561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:13.530873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.532350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.545784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 345/715] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:13.547565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.551703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.636494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:13.679111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa901396-c9d7-44ae-8e8a-78f756d4d4ad None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.715078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.716202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.716633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.717055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.717890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.719409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:13.733891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:13.735038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:13.735935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:13.737995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 371/716] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:13.744614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:13.749465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f450c-7d88-48ad-9303-378e33316360 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.792389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:13.818643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.819318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.819611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.820178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.820859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=450a31adc83e4bf0a8b21c86806981a9) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:13.821182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.823230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.836038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 346/717] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/role_assignments?user.id=450a31adc83e4bf0a8b21c86806981a9&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:13.880566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173169d0-703b-4297-822a-3e84812c5fd7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:13.908534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:13.921165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:13.921962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:13.922261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:13.922540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:13.923315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:13.923629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:13.925060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f6244-ce9d-4a4c-92e4-f63c20d46bcf None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:13.930439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 372/718] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:13.941048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:14.088237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a2e3-720c-4306-a187-75978d787aff None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:14.123482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:14.124181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.124466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.124742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.125458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:14.125766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:14.127118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f066dc-c248-4cf1-bdbb-fd24f5ed33f1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:14.133278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 347/719] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 00:15:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:15.134562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1afb5-d87f-457c-a879-b541c8c4c1e8 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.135118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1afb5-d87f-457c-a879-b541c8c4c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.135118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1afb5-d87f-457c-a879-b541c8c4c1e8 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.136895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 373/720] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:15.142967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.143926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.144446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.168956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:15.170533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:15.225651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:15.258513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 348/721] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:15.304052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1afb5-d87f-457c-a879-b541c8c4c1e8 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.430390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1afb5-d87f-457c-a879-b541c8c4c1e8 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.466650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3173e87-d494-47fa-830b-be004bd1c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.467821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3173e87-d494-47fa-830b-be004bd1c432 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.468340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3173e87-d494-47fa-830b-be004bd1c432 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.468847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3173e87-d494-47fa-830b-be004bd1c432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.480207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3173e87-d494-47fa-830b-be004bd1c432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-b3173e87-d494-47fa-830b-be004bd1c432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:15.488124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:15.489024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:15.489837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:15.492699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 374/722] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:15.501019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.594086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4508c4-9555-487a-a8e3-097593a4fa1b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.594408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4508c4-9555-487a-a8e3-097593a4fa1b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.594605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4508c4-9555-487a-a8e3-097593a4fa1b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.596232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 375/723] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:15.609820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d693-3110-48a1-8926-351574dc1009 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.610109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d693-3110-48a1-8926-351574dc1009 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.610381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d693-3110-48a1-8926-351574dc1009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.637210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e860d693-3110-48a1-8926-351574dc1009 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:15.638428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e860d693-3110-48a1-8926-351574dc1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:15.659073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ec834-8a20-4804-a53c-2caad8217e14 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.699985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.701155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.701657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.702245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.703336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:15.703856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:15.705488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:15.715573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 349/724] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:15.724268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:15.726106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.778172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 376/725] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:15:15.803900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:15.822572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860d693-3110-48a1-8926-351574dc1009 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.938770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860d693-3110-48a1-8926-351574dc1009 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.942012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb5108-09df-4829-b620-e1c53aebfda8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.976754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.977552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.978135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.978496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.997159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:16.009612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:16.010704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:16.011527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 377/726] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:16.024190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.025803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.026608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.026888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.027160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.051220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.052751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:16.093906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:16.094851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:16.095733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:16.095733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:16.095733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:16.095733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:16.101646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 350/727] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:16.110814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.116480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.183718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ec038-327e-4d8c-b49f-e29f9eb959d9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.225465 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.226580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.227133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.227628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.229627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:16.230231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.230881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.233527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37895945-fc07-4f94-9280-6a122b5b0876 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.240516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e92763-1c32-425d-8afe-99d8b3dfdd52 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.248571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 378/728] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:16.250354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ab3c-39c2-4f80-9e69-b4d29ac8993a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.250805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ab3c-39c2-4f80-9e69-b4d29ac8993a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.251239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ab3c-39c2-4f80-9e69-b4d29ac8993a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.253209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 379/729] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:16.254199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4ab3c-39c2-4f80-9e69-b4d29ac8993a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.281875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.282541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.282829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.283110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.283839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:16.284181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.286340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de7e1-25fe-47a0-915d-13e9d26aa464 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.305646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 351/730] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:16.307805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.308026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.308368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.326252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:16.327638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:16.377602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.382932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4ab3c-39c2-4f80-9e69-b4d29ac8993a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.401679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 352/731] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:16.402539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.428982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.430040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.430331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.430655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.441961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.443402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-33a56e37-3939-426b-ad58-3696aa3ef659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:16.461781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:16.463536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 380/732] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e028cb0-ea5d-4bab-8c31-df1ea000d758 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e028cb0-ea5d-4bab-8c31-df1ea000d758 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e028cb0-ea5d-4bab-8c31-df1ea000d758 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.469452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 381/733] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:16.469971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e028cb0-ea5d-4bab-8c31-df1ea000d758 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.505727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.526675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7c625-88b9-479c-b5bd-b82614599af3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.562044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.562843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.563128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.563416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.570909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.572522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.577037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e028cb0-ea5d-4bab-8c31-df1ea000d758 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:16.588128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:16.589304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 353/734] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:16.590269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.624425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0aed1-0159-47d4-b1fd-59dc8d4f5a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.625089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0aed1-0159-47d4-b1fd-59dc8d4f5a20 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.625374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0aed1-0159-47d4-b1fd-59dc8d4f5a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.625904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0aed1-0159-47d4-b1fd-59dc8d4f5a20 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.626367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0aed1-0159-47d4-b1fd-59dc8d4f5a20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.627736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0aed1-0159-47d4-b1fd-59dc8d4f5a20 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.656301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 382/735] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:16 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:16.657670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.657970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.658233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.684230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:16.685632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:16.695556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.730392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdf65-1cdb-42d7-8ca9-9e06ac999b55 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.781619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 383/736] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:16.782990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.793626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.794404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.794791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.795148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.796016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:16.796440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.798132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66dba-ed4d-48ce-80d4-43ee26c87dd3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.808614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.816084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 354/737] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:16.817761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3c8d-234b-4865-850a-da73097d7611 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.817761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3c8d-234b-4865-850a-da73097d7611 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.818044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3c8d-234b-4865-850a-da73097d7611 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.819406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 355/738] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:16.824004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3c8d-234b-4865-850a-da73097d7611 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.907203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81ee7-c5c6-41d6-af68-a0ca5a19be81 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.938151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3c8d-234b-4865-850a-da73097d7611 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:16.943402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.944119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.944408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.944692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.945539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:16.945858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:16.947329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:16.956292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:16.972627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 384/739] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:16.972627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:16.976039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78285e97-176e-4575-b7b2-72b884b2e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:16.976919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285e97-176e-4575-b7b2-72b884b2e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:16.977207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285e97-176e-4575-b7b2-72b884b2e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:16.977482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78285e97-176e-4575-b7b2-72b884b2e3a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:16.990066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78285e97-176e-4575-b7b2-72b884b2e3a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-78285e97-176e-4575-b7b2-72b884b2e3a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:16.997780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:16.998720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:16.999552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 356/740] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:17.000279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.001003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.001003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.018420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:17.019199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:17.082185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.092762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00718d8-9f62-4598-b17a-7febaf5effab None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.097934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 357/741] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:15:17.098617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.136373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.137198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.137485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.137762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.145141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.146592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:17.162758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:17.163707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:17.164675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 385/742] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:17.165261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.209297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f61bd3-1360-4894-9a03-424bbd655874 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.230167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.250016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.250672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.250954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.251232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.277363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba6ca3-b932-46a2-838b-05ddb12710dd None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.310476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.317543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.318227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.318523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.318808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.319568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:17.319904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.321294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.328651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.330101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.335644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 386/743] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:17.335644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.440639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5737ec-f30d-472b-9528-efd25821e73b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.442537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 358/744] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:15:17.443444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.459321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.479658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.480356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.480641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.480920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.481640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.483008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.497742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 387/745] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:17 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:17.498596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.559111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.579480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29276f-03a3-4924-b855-ff6d6b172878 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.644022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdf9c5-1473-4651-a5f3-0a3d6e0ee68f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.648206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.648904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.649195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.649479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.650737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:17.651299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.654460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.684265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 359/746] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:17.684929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.687012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.688038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.688417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.688819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.703841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.706761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:17.730565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:17.731482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:17.732453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:17.732453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:17.732453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:17.732453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:17.734665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 388/747] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:17.735685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.768418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.808842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b843-ab43-46d3-a9be-116eb2f12c09 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.850209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.851365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.851908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.852558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.862362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d10c92-494b-4455-b936-dee0202c556c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.864280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.865970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.868070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:17.888940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:17.889900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:17.890792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:17.890792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:17.890792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:17.890792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:17.897758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 360/748] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:17.899015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.902176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.902837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.903129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.903415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.987652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.989553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.017841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.031987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f2c1a-9471-456d-9802-85713a2cea20 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.084392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.085069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.085360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.085645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.086601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:18.086853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.089100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.101167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 361/749] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:18.102042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.117715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 389/750] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:18.119503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.160259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.212203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7f80d-67f9-43e2-b683-11d1862036b8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.244121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8597-9037-49f1-a2d3-5bb640a65636 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.252944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.253723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.254085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.254436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.255302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:18.255682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.257200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.270120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 362/751] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:18.276061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.282774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.295412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.296518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.297118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.297584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.307845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.310018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:18.329197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:18.330170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:18.331074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:18.333730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 390/752] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:18.334678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.399016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e52f0-0219-4b9c-832d-11ccd0bbbfc5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.418487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.445296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.446154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.446447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.447312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.458835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.460473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.462832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea267381-1b8d-48ee-bbce-cf91e2119b1a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:18.480806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:18.481741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:18.482621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:18.482621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:18.482621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:18.482621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:18.482621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 363/753] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:18.483345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.502667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.503909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.504415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.504892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.512981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.514940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:18.529334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:18.530215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:18.531141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:18.533366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 391/754] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:18.538867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.589504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.593559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52782a-3200-4efe-891f-0848ef31d3a8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.632063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.633167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.633601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.634032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.635635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:18.636129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.637833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.649492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eac44-2728-431b-a961-7dcf9d44cfe6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.661899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 364/755] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:18.663022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.686148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.686957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.687351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.687903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.688635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:18.689040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.690778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.691165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.706434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 392/756] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:18.707653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.773326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c10f-b2e2-4d54-84f2-b6bfcbc12ff2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.815303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.816017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.816310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.816594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.817405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:18.817725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.819179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.827459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd31977-4920-4afd-89cb-5de04644bfed None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.837456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 365/757] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:18.837456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.848234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.871065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.872185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.872654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.873116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.883607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.885703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:18.907425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:18.908413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:18.909305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:18.909305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:18.909305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:18.909305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:18.912155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 393/758] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:18.912827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:18.930467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:18.949086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04172-d6ae-424f-be0b-e244d1948d05 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:18.985133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:18.985938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:18.986236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:18.986523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:18.993266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:18.994992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-b82769e8-2367-45bb-8382-b0d886ff12a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:19.009012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:19.010130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:19.011230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:19.014824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 366/759] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:19.016136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca492a0-219b-4aa8-955c-453b360d3840 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.016438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca492a0-219b-4aa8-955c-453b360d3840 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.016725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca492a0-219b-4aa8-955c-453b360d3840 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.018009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 367/760] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:19.018711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca492a0-219b-4aa8-955c-453b360d3840 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.029433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d956-36a2-430e-9b2e-94335f7b581a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.072067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.072758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.073042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.073320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.074144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=0f7484f9ef764101977c9da152a7ab75) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:19.074457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.075898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.081907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 394/761] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:18 2022] GET /identity/v3/role_assignments?user.id=0f7484f9ef764101977c9da152a7ab75&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:19.092946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.131419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:19.139319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca492a0-219b-4aa8-955c-453b360d3840 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.181610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.182274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.182381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.182636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.183461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:19.183786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.185236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ccba0-7acc-4689-b62e-7a70f0f8abbe None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.202956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 368/762] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:19.204607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.204835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.205129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.220259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:19.223010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:19.224353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:19.253171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211226ed-cef4-414f-b566-7ce83fdddb42 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.300237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.301152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.301645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.302123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.303089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:19.303578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.305426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.307539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 369/763] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:19.308792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.319752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 395/764] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:19.333083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.429947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:19.453716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26b16-8de5-4385-801a-f21b607e1af7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.455221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad4030-eb03-47bc-bca5-9a68781d6ff6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.490876 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.491915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.492695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.493389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.495600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=30d9ec9bc1514acdb359d5959e1597c6) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:19.496247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.498200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.500457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.501535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.501823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.502104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.504998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:19.506437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 396/765] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/role_assignments?user.id=30d9ec9bc1514acdb359d5959e1597c6&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:19.507451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.518786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.525320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:19.547468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:19.548458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:19.549362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:19.562633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 370/766] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:19.569986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.654785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8a26c-1226-4139-91fa-8da815f706ac None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.692065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.692884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.693169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.693448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.696061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.698222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:19.715039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:19.716128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:19.716949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 397/767] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:19.724660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.754400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:19.803233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994bef-291f-4879-9882-5aedfe5f66f4 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.855034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.856134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.856426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.856708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.857507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:19.857878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.860168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c92a-ffa7-41a7-bc7a-50b36482a9c7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.871574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59d4a-40e8-4d7e-a13f-f97f0f07a3d8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:19.877626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 371/768] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:19.878963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e8f1-f252-41d1-b7bb-4cd5244f563f None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.879254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e8f1-f252-41d1-b7bb-4cd5244f563f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.879533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1e8f1-f252-41d1-b7bb-4cd5244f563f None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.888170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 372/769] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:19.889044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e8f1-f252-41d1-b7bb-4cd5244f563f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:19.927511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:19.928227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.928517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.928799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.929777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] RBAC: Adding query filter params (name=network) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:19.930088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:19.933045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421386-1521-4e8e-949e-7895c88e179b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:19.939464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 398/770] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:19.941450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.942161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.942509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.955797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:19.967750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:19.969530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:20.006045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1e8f1-f252-41d1-b7bb-4cd5244f563f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.044816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.047983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.047983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.047983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/450a31adc83e4bf0a8b21c86806981a9/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.049468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=450a31adc83e4bf0a8b21c86806981a9, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.051080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.072356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 373/771] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:19 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/450a31adc83e4bf0a8b21c86806981a9/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:20.072356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.083920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 399/772] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:20.108309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.118090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.213589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10e066-a99b-4727-a8f5-523d0548e907 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.231262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.256787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.258227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.258828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.259480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.260689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:20.261512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.263143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.270037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 374/773] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.276304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.352507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebf57f-dd8e-4191-b347-3e726fa7510d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.396293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.397248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.397730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.397840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.398451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.400387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.406239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b1919-2b18-4e79-a532-515199c526b5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:20.423341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:20.424364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:20.425179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:20.432918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 400/774] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:20.441444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.453747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.454776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.455265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.455758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.457219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] RBAC: Adding query filter params (interface=public, service_id=b99cf9db663d4a5bae049cda94e4b16b, region_id=RegionOne) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:20.457743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.459301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.468582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 375/775] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/endpoints?service_id=b99cf9db663d4a5bae049cda94e4b16b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.473731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.580339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.586143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c3d2-5f61-4bde-a9ba-72f9be817f52 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.624324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.625337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.625843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.626317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.626422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.627792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.629370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.635886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 376/776] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:20.719684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19472a7f-49e8-446a-a1b6-ac1e32ae5a09 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.786765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.787453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.787749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.788057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.788791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:20.789167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.790689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.802375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 401/777] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.807725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.929430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129b462-bfdc-49c3-bbbd-bd8bf6e8d99b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.937584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.975430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.976144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.976433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.976712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.977427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:20.977733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.980241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.986222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 377/778] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.993024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:21.167614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392e7c3-8ff2-4b95-add7-79ae0d22bb70 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:21.208271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:21.215084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:21.216019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:21.216638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:21.216922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:21.217721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] RBAC: Adding query filter params (interface=public, service_id=9281dd12feb94c9fa311631dece0bdf5, region_id=RegionOne) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:21.218040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:21.219410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff508-d342-4789-b81f-f52ed605a0c1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:21.227496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 402/779] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/endpoints?service_id=9281dd12feb94c9fa311631dece0bdf5&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:21.233308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:21.348698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91844a28-14c8-411d-aa62-1637c3951335 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:21.383801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062622-1d70-4eaa-86ef-d830e027f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:21.384600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062622-1d70-4eaa-86ef-d830e027f7ce None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:21.385132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062622-1d70-4eaa-86ef-d830e027f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:21.385411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062622-1d70-4eaa-86ef-d830e027f7ce None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:21.386115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062622-1d70-4eaa-86ef-d830e027f7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:21.387528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062622-1d70-4eaa-86ef-d830e027f7ce None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:21.394108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 378/780] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:21 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:21.457445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc84879-9043-4b73-8317-b83e3e75cdc2 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:21.457972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc84879-9043-4b73-8317-b83e3e75cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:21.458149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc84879-9043-4b73-8317-b83e3e75cdc2 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:21.459974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 403/781] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:21.465758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:21.466254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:21.466334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:21.484846 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:21.486127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:21.518512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:21.576829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 379/782] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:21.610170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc84879-9043-4b73-8317-b83e3e75cdc2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:21.751188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc84879-9043-4b73-8317-b83e3e75cdc2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:21.790163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:21.791212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:21.791501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:21.791781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:21.806782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:21.814452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:21.815382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:21.816245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 404/783] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:21.823516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:21.967583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424bc9-70e0-44c5-a284-531de1673fcd None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.018064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.018667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.018962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.019245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.020026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:22.020340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.021697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18ec3a-eacf-41fb-92c6-4b562e1aadd8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.035499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 380/784] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:22.041439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.123325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.185082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cec97-8aa3-4dae-a50c-c6dae63f013a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.206512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32bf1-0a5a-4325-b77b-eedbb4a8f1d2 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.206835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32bf1-0a5a-4325-b77b-eedbb4a8f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.207082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32bf1-0a5a-4325-b77b-eedbb4a8f1d2 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.208606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 381/785] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:22.213700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963336-64c2-4769-a74a-01f643866857 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.213993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963336-64c2-4769-a74a-01f643866857 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.214278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963336-64c2-4769-a74a-01f643866857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.245594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-09963336-64c2-4769-a74a-01f643866857 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:22.247783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-09963336-64c2-4769-a74a-01f643866857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:22.253384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.254468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.254970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.255444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.277597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.279565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.294619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:22.308812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:22.309760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:22.310632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:22.310632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:22.310632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:22.310632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:22.312889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 405/786] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:22.318003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.379138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 382/787] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:22.425283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963336-64c2-4769-a74a-01f643866857 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.474644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377974a-3183-4297-80b8-19792c87b795 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.489668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.523229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.524280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.525323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.525924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.526845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:22.527352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.530350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.553611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 406/788] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:22.559920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.643243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963336-64c2-4769-a74a-01f643866857 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.710539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.711593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.712207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.715861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.734068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:22.747611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e521b0-f2eb-4262-bde6-88ab6227d4de None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:22.756428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:22.757565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:22.758592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:22.768860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 383/789] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:22.770675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.808323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.831567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.832410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.832699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.833046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.855621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.857149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:22.882299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:22.883502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:22.885408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:22.892390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 407/790] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:22.897869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.940412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f165ad-42ca-4bc6-a7da-d7e0780fae77 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.956136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.981632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.982519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.982877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.983227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.984126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:22.984508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.986107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb32da-838a-41f7-ba64-05aa44d3e77c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.996778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 384/791] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:23.002413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c9ca-03b9-4158-8842-0e34a83cca56 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.002715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c9ca-03b9-4158-8842-0e34a83cca56 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.002994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c9ca-03b9-4158-8842-0e34a83cca56 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.008704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 385/792] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:23.008704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9c9ca-03b9-4158-8842-0e34a83cca56 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.054595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8e4e3-ab73-49a2-84d0-41adce000894 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.095439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.096070 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.096359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.096642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.097482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:23.097795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.099226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49484f-1594-4c54-a806-b3f8ca19448e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.115775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.124049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 408/793] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:23.125458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.125758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.126045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.142180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:23.143347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:23.145798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9c9ca-03b9-4158-8842-0e34a83cca56 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.185502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.186669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.187275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.187782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.202105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.204061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.224415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 409/794] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:23.225445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:23.226995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:23.229355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:23.230276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:23.230276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:23.230276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:23.230276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:23.238430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 386/795] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:23.241157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.267084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.361377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943df083-b965-4b92-8eb2-9c7d3cc5fd2d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.362708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96673f-f87c-45c1-8c92-683e92cc48c6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.393904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.399609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.400536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.401009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.401241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.401398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.401505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.401580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.401754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.402462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:23.402772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.404170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.412722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.414165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.416640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 387/796] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:23.417461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-b86d2a37-cd92-4f5d-a7f7-34d4bb5c7b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:23.438732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:23.439660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:23.440610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:23.440610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:23.440610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:23.440610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:23.440610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 410/797] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:23.441730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52e8d-c8ff-4551-8f8b-6a9cced8cc42 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.441730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52e8d-c8ff-4551-8f8b-6a9cced8cc42 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.441904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52e8d-c8ff-4551-8f8b-6a9cced8cc42 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.443480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 411/798] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:23.448016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52e8d-c8ff-4551-8f8b-6a9cced8cc42 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.539663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.547769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed69e31-957b-4d70-8f17-8fcf2d419284 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.578717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52e8d-c8ff-4551-8f8b-6a9cced8cc42 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.585461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.586648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.586937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.587216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.599166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:23.607092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:23.608058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:23.608878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 388/799] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:23.609564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.619903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.620682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.620974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.621254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.629470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.630920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1ba26cdf-995c-4f3e-a2a2-49e70c9c6b26 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:23.647473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:23.648571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:23.649522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 412/800] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:23.650144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.650939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.650939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.668757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:23.669946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:23.671414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.723709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f232920-9161-4cdc-9577-f157f325ef0c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.755906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 413/801] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:23.755906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.774012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.774687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.774979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.775314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.776013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:23.776330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.777716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.789869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 389/802] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:23.791260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.818029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.864020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5578c6-efdf-4406-930e-bfbc8f521a6c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.899523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477300-bae3-477b-a809-fe611e6fa31a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.899924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.900602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.900889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.901282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.902035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:23.902341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.903728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.910931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:23.917868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 414/803] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:23.917868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.936335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.937015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.937306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.937589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.938435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:23.938748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.940189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.957499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 390/804] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:23.958298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.015260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f48d7-bd3a-43ac-8a4a-fc1af7808eb0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.034264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.049540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.050687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.050778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.051028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] PATH_INFO: `/v3/services/network` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.051686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.053109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.058185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508dbc-8931-48f7-acb2-6c38decc4d1c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-aae7ec15-9d3d-4c00-944d-841c23ee2f6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:24.065676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:24.066673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:24.067499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 415/805] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:24.068424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0571d8-e14f-4aad-a0f0-685f809603e5 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.068424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0571d8-e14f-4aad-a0f0-685f809603e5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.068703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0571d8-e14f-4aad-a0f0-685f809603e5 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.070860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 416/806] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:24.071550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0571d8-e14f-4aad-a0f0-685f809603e5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.099601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.100429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.100720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.101000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.108303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.109742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:24.123895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:24.124946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 391/807] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:24.130714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.158693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.173057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0571d8-e14f-4aad-a0f0-685f809603e5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.206336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.207119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.207401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.207678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.218686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.220152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.230452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3e90-1dfc-4893-9a36-77c91a1137ee None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:24.237653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:24.238664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:24.244316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:24.244316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:24.244316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:24.244316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:24.244316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 417/808] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:24.244316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.265685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.266995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.267516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.268064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.275478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.281245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.282692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-458be640-dacf-4023-aeac-28be0268eb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:24.300154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:24.301168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:24.302050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:24.302050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:24.302050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:24.302050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:24.302050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 392/809] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:24.302592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.302812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.303039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.318726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:24.319923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:24.344547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b003-56ec-47c5-83a9-a428780282c9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.378270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.378923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.379437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.379551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.380196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] RBAC: Adding query filter params (name=network) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:24.380499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.381866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.386935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 418/810] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:24.387213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 393/811] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:24.387524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.388134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.400623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.488006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d60a8-6cd1-49d6-bc94-5adb482f1805 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.488561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.491575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6262d-e397-4e5d-b0d0-d34aa837dc3f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.521181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.521842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.522126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.522412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.523118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:24.523425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.524885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.525559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.526217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.526512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.526786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.527689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:24.528041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.529460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.536180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 394/812] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:24.536986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.546474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 419/813] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:24.547299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.606310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.639471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996396-18aa-41a6-ab60-81440b2b86e1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.648124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734ec2-a73a-4b2e-b5c4-83f7fc1a9b6e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.673697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.674373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.674657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.674939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.675662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:24.676001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.677362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.682276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.682945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.683237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.683522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.684262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] RBAC: Adding query filter params (type=network) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:24.684577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.685933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.689397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 395/814] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:24.690193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.695030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 420/815] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:24.695030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.718672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.792773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8b935-5745-40ad-a6ea-0e4d551c46f9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.794498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563233d8-c6d7-4f14-b110-1c0931410def None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.820124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.826363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.827173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.827459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.827598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.827740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.828275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.828434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.828560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.828835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.829794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.836049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.837970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:24.844146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:24.845238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:24.846159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 396/816] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:24.846993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:24.856739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:24.857667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:24.858581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 421/817] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:24.859147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:24.946409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:24.949986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6f87e-35c9-47ac-8557-68294bfc043d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.963757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963a51f-e71c-4b2d-a20a-548a795d0ce1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:24.985697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.986589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.986880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.987161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/0f7484f9ef764101977c9da152a7ab75/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.989134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=0f7484f9ef764101977c9da152a7ab75, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:24.990575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:24.998321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:24.999254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.999566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.999843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.004025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 397/818] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:24 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/0f7484f9ef764101977c9da152a7ab75/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:25.004817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.006714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.008225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:25.022956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:25.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:25.026048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 422/819] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:25.026542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.085021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.143018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ede2b-ba87-43da-aead-219c9253ddcc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.143386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875054a-a1be-41da-ba06-4b3f531ee75b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.184687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.185362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.185647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.185927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.186615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.186732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.187288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.187576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.187866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.188048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.188593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:25.188903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.190260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.195470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 423/820] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:25.196128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.211107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 398/821] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:25.212451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.216469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.330326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411feac-66c0-4650-aeb8-48ed2bbdc1c3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.351296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd42c27-50b3-477c-8262-d6c17e891c31 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.368279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.379701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.380882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.381180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.381620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.382617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:25.382942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.385452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.395726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.396160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.397379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.397379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.398017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:25.401174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.401174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.405982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 424/822] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:25.406912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.413468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 399/823] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:25.419049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.489309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.531523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62070-2caf-42d7-9b54-d601705aa57d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.547351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb13af-2693-4084-9879-49bb95ed7868 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.567360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.568065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.568355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.568635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.569360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:25.569670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.571038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.580466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 425/824] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:25.580466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.588783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.589511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.590005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.590144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.627908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.666588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.668502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.686693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3db8-0995-40c0-acf0-9ab41c966e06 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.782150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 400/825] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:25.782150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.836366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.843217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.844135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.844428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.844708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/30d9ec9bc1514acdb359d5959e1597c6/roles/761beeab640c4d539743da31146304a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.858001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.861531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=30d9ec9bc1514acdb359d5959e1597c6, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.863005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.875761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 426/826] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:25 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/30d9ec9bc1514acdb359d5959e1597c6/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:25.876940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.911543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501642c4-7a89-4766-bf46-e446be9e57b6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.966123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.967561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.968127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.968814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.971148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.973790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:26.003066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f8ae5-a0e6-479e-b34c-e8da5d9ab372 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:26.006792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 401/827] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:26.069949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:26.071168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:26.072280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:26.072847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:26.085467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:26.088126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:26.108736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:26.109700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:26.110625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:26.110625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:26.110625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:26.110625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:26.111636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 427/828] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:26.121080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:26.265253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3aa76-2f95-4a7d-b39b-232430549387 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:26.291664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:26.305315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:26.305988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:26.306463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:26.306754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:26.307499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:26.307815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:26.309237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:26.322831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 402/829] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:26.327961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:26.357683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:26.432490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f5b7-d784-44ad-ad02-3f685bd4d2df None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:26.466568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:26.467364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:26.467645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:26.467938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:26.474751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:26.476224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:26.490762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:26.491650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:26.493052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 428/830] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:26.498735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:26.600086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c303d9-b717-48c9-a490-61ab9bdcab58 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:26.635577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:26.636570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:26.637062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:26.637517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:26.638484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:26.638969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:26.640600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b09bd-220f-48d4-b496-e75286d2f519 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:26.654724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 403/831] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:26.660884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:26.760282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:26.766077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b17a4-c5f5-4a28-afd9-583b74a8cd01 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:26.802308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:26.802964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:26.803244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:26.803523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:26.804399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=450a31adc83e4bf0a8b21c86806981a9) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:26.804715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:26.806286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bce5e-006b-4f5f-be60-e18b849f8ff1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:26.820031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 429/832] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:26 2022] GET /identity/v3/role_assignments?user.id=450a31adc83e4bf0a8b21c86806981a9&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:27.207920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a69be-46c7-4eea-8446-4074772230ac None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.208461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a69be-46c7-4eea-8446-4074772230ac None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.208461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a69be-46c7-4eea-8446-4074772230ac None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.210086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 404/833] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:27.216435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.216730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.217021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.234366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:27.235561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:27.309471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 430/834] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:27.332433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a69be-46c7-4eea-8446-4074772230ac None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:27.378893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:27.439664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a69be-46c7-4eea-8446-4074772230ac None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:27.477801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:27.478895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.479184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.479464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.490628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:27.498323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:27.499213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:27.500067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 405/835] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:27.505383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:27.597020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:27.616011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4978b-6e52-43f6-b2e5-5229caca6a89 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:27.650813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:27.651488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.651771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.652075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.652825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:27.653132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:27.654514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:27.663391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 431/836] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:27.668887 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:27.776855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381da6a1-3c06-437a-bf6b-68dfa96fb017 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:27.778385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:27.812893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:27.813693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.813982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.814259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.824866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:27.826312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:27.844441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:27.846310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:27.847546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:27.847546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:27.847546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:27.847546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:27.847546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 406/837] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:27.851150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:27.953893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016dc7-9c73-4f5b-8dab-f7a9d2c262b0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:27.990864 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:27.991583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.991887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.992171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.992946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:27.993252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:27.995069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.007481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 432/838] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:28.017031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.131504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0260540-4940-409d-95cc-3c5c9fcaa226 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.173793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.174628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.175238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.175520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.184760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.186251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-b47fb530-7423-47f2-8eb0-c5c9c04fa393 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:28.202635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:28.203647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:28.204610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 407/839] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:28.213176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.224331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.232705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b0d21-57b3-4878-ba06-e5f56f8d5681 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.233211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b0d21-57b3-4878-ba06-e5f56f8d5681 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.233292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b0d21-57b3-4878-ba06-e5f56f8d5681 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.234918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 408/840] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:28.239798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.240128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.240546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.266254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:28.267828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:28.280309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.341178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0e914-18b1-4260-9e22-29ecaaddfe20 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.352664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 409/841] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:28.375947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.386729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.387342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.387630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.387933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.388780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:28.389211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.390520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fcf52-6356-4097-aead-1f859a5ab647 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.408594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 433/842] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:28.409740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9297-ddab-467f-8bbf-7be17dd71830 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.410033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9297-ddab-467f-8bbf-7be17dd71830 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.410313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9297-ddab-467f-8bbf-7be17dd71830 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.411648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 434/843] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:28.416276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9297-ddab-467f-8bbf-7be17dd71830 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.484998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.487419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f74d95-ba10-43ac-9aaf-2271ee432af6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.523329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3d565-472c-41fe-8314-57fe2296516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.524174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d565-472c-41fe-8314-57fe2296516c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.524465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d565-472c-41fe-8314-57fe2296516c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.525257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3d565-472c-41fe-8314-57fe2296516c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.527130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9297-ddab-467f-8bbf-7be17dd71830 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.535674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3d565-472c-41fe-8314-57fe2296516c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-1eb3d565-472c-41fe-8314-57fe2296516c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:28.544055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:28.545017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:28.545842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 410/844] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:28.547019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.547019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.547176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.552839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.565048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:28.566240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:28.568417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.569096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.569379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.569655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.635118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 411/845] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:28.636404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.646090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.647494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.712867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.751113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076bbce-13a8-4c5c-9803-afeed8f9167b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.764843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 435/846] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:28.764843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.787382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.788090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.788766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.789076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.789817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:28.790129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.791573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.793091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.802659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 412/847] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:28.808316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.875621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44000-785a-4d29-bf1d-5b1c8c30b4cc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.912216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.912935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.913223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.913538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.914152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.916072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.922770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffcd44-5d17-415c-b8b3-d0d82758d110 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:28.927844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:28.928823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:28.929656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 436/848] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:28.930449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.959716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.965658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.966579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.966872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.967156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.979772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.981560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:29.000530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:29.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:29.007364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:29.007364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:29.007364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:29.007364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:29.007364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 413/849] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:29.007364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.042874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003693b-f7b6-4c2a-acfc-479663de5fcb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.067023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.085485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.086418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.086799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.087158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.099351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.101130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:29.120924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:29.122047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:29.122936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:29.122936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:29.122936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:29.122936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:29.122936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 437/850] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:29.122936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.135672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520d92a-d090-44d8-8e34-ccf1c98445b2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.170659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.171255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.171545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.171827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.172571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:29.172884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.174261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.178675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 414/851] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:29.179449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.204521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.227295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4833b4-7480-4f8c-a772-e442fd5d0489 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.263660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.264364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.264651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.264931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.265660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:29.265969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.267357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518584-5866-47e9-8ca7-f5c5ffe68b72 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.280777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 438/852] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:29.282209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbc1c6-644b-468a-9d50-7a9ddbc71016 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.282504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbc1c6-644b-468a-9d50-7a9ddbc71016 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.282781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbc1c6-644b-468a-9d50-7a9ddbc71016 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.284252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 439/853] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:29.285821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbc1c6-644b-468a-9d50-7a9ddbc71016 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.390756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbc1c6-644b-468a-9d50-7a9ddbc71016 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.398088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dee4-32d6-4fac-90ca-aa2dcca1b417 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.411464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.426324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.426926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.427216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.427493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.428228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:29.428542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.429911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.434436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.434568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 440/854] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:29.435108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.435315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.435412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.435661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.436417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:29.436732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.438119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2efe8-805a-4ed7-a05e-e328b7daa134 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.446146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.455904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 415/855] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:29.457040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.457329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.457605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.475716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:29.476981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:29.564181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 416/856] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:29.564181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.564456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d08209-ef4f-4504-bc46-ddbc0a272392 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.605578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.606966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.607422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.607840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.615082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.617002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:29.632562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:29.633681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:29.635308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:29.637424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 441/857] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:29.638376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.684690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01578-6142-4bea-a75c-b90ff5ea3899 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.686320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.705500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.724026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.724848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.725136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.725417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.733362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.734844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:29.749931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:29.750899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:29.751822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 417/858] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:29.752918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.753244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d716f-bbe9-4e84-8436-7e564178882e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.792527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.793346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.793679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.793964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.794618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.796016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:29.808735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:29.809678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:29.811145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 442/859] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:29.812053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.865565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd932-c36e-41c4-b8da-0b30130c66aa None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.901238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.901902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.902189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.902468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.903252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:29.903562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.905014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.918026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 418/860] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:29.918859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:29.920130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80926453-bf1f-445c-9b55-22b308308fb4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:29.946383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.952052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:29.962292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:29.963331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:29.963654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:29.964056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:29.964897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:29.965209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:29.966750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:29.987610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 443/861] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:29.988724 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.032196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692e269-b4ad-4cd3-bcf7-eb239a055153 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.076871 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.077550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.077841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.078119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.078832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:30.079142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:30.080540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:30.085456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 419/862] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:30.086048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.105541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b01ca-945f-4081-93ed-40172fb1fdc8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.141684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.142344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.142638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.142913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.143749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=0f7484f9ef764101977c9da152a7ab75) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:30.144092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:30.145520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:30.153120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 444/863] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:29 2022] GET /identity/v3/role_assignments?user.id=0f7484f9ef764101977c9da152a7ab75&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:30.153946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.202071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:30.222524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:30.224984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14432ebe-3e23-42a7-a4a7-893162bf6712 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.277079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.278863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.279361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.280189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.287237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5eab-6d24-4199-b9d5-be6211156f5b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.327485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.328334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.328629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.328910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.329745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:30.330064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:30.331468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:30.337140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 445/864] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:30.378988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:30.380496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:30.485895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:30.506953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 420/865] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:30.511736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.626711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447dbb8-69bf-4441-8478-5aebd2fed7ca None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.643349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:30.672189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.673056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.673348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.673631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.684799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:30.686373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:30.705393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:30.706309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:30.707187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:30.707187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:30.707187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:30.707187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:30.707187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 446/866] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:30.712646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.814929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcbc62-d35c-488e-b868-8b690668f0d5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.849871 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.850546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.850837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.851121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.851850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:30.852190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:30.854438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:30.866189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 421/867] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:30.871803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.970008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27e1bb-550c-4d36-ad50-e71d5955ee81 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.010518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.011311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.011600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.011898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.018753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.020229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:31.034031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:31.034930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:31.035795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 447/868] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:31.041283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.090884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:31.154455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe923b-930c-41d2-b341-8c2fe923b077 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.189752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.190417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.190770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.191058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.191922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:31.192247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.193667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f287fe-321c-45d4-838c-d1917b3a3988 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.206136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 422/869] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:31.212101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.239429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:31.317500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14a93c-3217-462a-a80a-9f153137e7c4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.351660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.352291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.352578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.353382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.354219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=30d9ec9bc1514acdb359d5959e1597c6) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:31.354538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.355994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ab54-6bf9-4d29-a178-a240e69ff300 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.362457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 448/870] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:31 2022] GET /identity/v3/role_assignments?user.id=30d9ec9bc1514acdb359d5959e1597c6&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:31.667727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a883c6-26b0-40f9-9b0e-dece3bd704de None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.668257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a883c6-26b0-40f9-9b0e-dece3bd704de None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.668257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a883c6-26b0-40f9-9b0e-dece3bd704de None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.669863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 423/871] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:31.675652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa729d-b2da-46ab-8771-dcefe7e8a023 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.675976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa729d-b2da-46ab-8771-dcefe7e8a023 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.676262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa729d-b2da-46ab-8771-dcefe7e8a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.698178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7eaa729d-b2da-46ab-8771-dcefe7e8a023 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:31.699393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7eaa729d-b2da-46ab-8771-dcefe7e8a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:31.783358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 449/872] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:31.826849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a883c6-26b0-40f9-9b0e-dece3bd704de None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.945326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a883c6-26b0-40f9-9b0e-dece3bd704de None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.954670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:31.985970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca4a4c-dc94-43c6-b028-53d0c44b9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.986640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4a4c-dc94-43c6-b028-53d0c44b9e82 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.986919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4a4c-dc94-43c6-b028-53d0c44b9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.987193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4a4c-dc94-43c6-b028-53d0c44b9e82 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.987951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca4a4c-dc94-43c6-b028-53d0c44b9e82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.989300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca4a4c-dc94-43c6-b028-53d0c44b9e82 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:32.006110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 424/873] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:31 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:32.655829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb458-d045-49c5-acec-31131e9f9526 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:32.656368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb458-d045-49c5-acec-31131e9f9526 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:32.656445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb458-d045-49c5-acec-31131e9f9526 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:32.658407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 450/874] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:32.659193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6851f9-6c3f-48e8-b4b4-6914afde50f3 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:32.659485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6851f9-6c3f-48e8-b4b4-6914afde50f3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:32.659765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6851f9-6c3f-48e8-b4b4-6914afde50f3 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:32.661364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 425/875] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:32.663472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:32.663774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:32.664087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:32.667173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:32.667465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:32.667748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:32.684073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:32.685389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:32.686532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:32.688107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:32.700409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:32.769397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 451/876] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:32.784656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 426/877] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:32.794478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:32.814527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:32.916255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f34f6-8e41-4979-bc4a-5831254bc898 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:32.933775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:32.942088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cfc3c-c4e3-4961-8d1b-fdbf84f8ff5e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:32.956877 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:32.957878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:32.958354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:32.958781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:32.959609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:32.961509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:32.974967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:32.976129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:32.976973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:32.980543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:32.980764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 452/878] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:32.981298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:32.981611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:32.981963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:32.982771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:32.991932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:32.992082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:33.003114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:33.011899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 427/879] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:32 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:15:33.148172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215fad3-f371-4daa-a1c9-b45d3b58b664 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:33.194305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:33.194887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.195181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.195478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.196871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:33.196871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:33.197989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a02b5-e647-4d18-8e94-00c9729a338d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:33.203380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 453/880] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:33.209165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:33.325960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b5bfd-4925-4278-8b91-25c7baec77fa None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:33.361805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:33.362477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.362817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.363106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.363821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:33.364159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:33.365528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d7b2-b593-4665-92c8-23ba384a7320 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:33.371337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 428/881] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:33.925957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55171c-6cf7-4da2-8ad3-6a9aa33b853b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.926994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55171c-6cf7-4da2-8ad3-6a9aa33b853b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.927490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55171c-6cf7-4da2-8ad3-6a9aa33b853b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.929376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 454/882] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:33.935784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ff26-f561-44da-9980-4204c5312888 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.936689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ff26-f561-44da-9980-4204c5312888 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.937178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ff26-f561-44da-9980-4204c5312888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.954772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b182ff26-f561-44da-9980-4204c5312888 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:33.956004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b182ff26-f561-44da-9980-4204c5312888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:33.971437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.032725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 429/883] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:34.063359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55171c-6cf7-4da2-8ad3-6a9aa33b853b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.134901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.175526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55171c-6cf7-4da2-8ad3-6a9aa33b853b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.215190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.215976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.216271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.216555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.229418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:34.237557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:34.238527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:34.239920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 455/884] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:34.243892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d1b9-a1e1-4e3b-a9ef-c6733cee3d21 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.244359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d1b9-a1e1-4e3b-a9ef-c6733cee3d21 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.244627 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d1b9-a1e1-4e3b-a9ef-c6733cee3d21 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.246375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 430/885] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:34.248853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.251058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.251354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.251637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.269160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:34.270467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:34.346432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 431/886] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:34.369283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.378045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f38af-9a05-46cc-8f7d-e9192433c772 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.414688 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.424863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c438-6532-4115-b727-016a850309a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.426072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c438-6532-4115-b727-016a850309a9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.426367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c438-6532-4115-b727-016a850309a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.426914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c438-6532-4115-b727-016a850309a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.427674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c438-6532-4115-b727-016a850309a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:34.428018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c438-6532-4115-b727-016a850309a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.429666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c438-6532-4115-b727-016a850309a9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.441337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 456/887] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.446604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c438-6532-4115-b727-016a850309a9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.475035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.499515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5045-654b-4c83-8649-27e95674e151 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.542664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.544109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.545037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.545520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.546859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.549001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:34.566027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:34.567158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:34.568005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:34.568738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c438-6532-4115-b727-016a850309a9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.571836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 432/888] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:34.583558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.605571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.606472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.606840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.607197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.619010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.620857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:34.638739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:34.639704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:34.640620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:34.640620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:34.640620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:34.640620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:34.644797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 457/889] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:34.645728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.696126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.720023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c145414-3723-4ca2-9dc8-d45992d43928 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.759163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddecb21-d8cb-488c-8d62-2817f7c44ace None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.768730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.769636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.770550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.771086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.772354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:34.772969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.776219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.787509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 433/890] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.788545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.800922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.808809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.810009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.810505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.811327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.812282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:34.812776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.814868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.832049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 458/891] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.838736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.919801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb9b2-8916-4eb0-9832-a2c36129ed85 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.956501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060bb0-a3ba-4a08-87c2-5fdb4e521164 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.958186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.960399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.961709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.962376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.962886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.963820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:34.964417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.966508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.974042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 434/892] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.980257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.997656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.998475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.998766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.999052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.006890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.008425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:35.024396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:35.025759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:35.026693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:35.030342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 459/893] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:35.031206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.075459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.112160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc105d3-a07e-428d-8716-0f582d7bc8f6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.150134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.150855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.151149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.151433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.152392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] RBAC: Adding query filter params (interface=public, service_id=68a3a34ca1cb406bbe6a8f5b7dd6af9b, region_id=RegionOne) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:35.152716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.154088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.158496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18810119-4492-4a16-bda8-fb305a83a1bb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.164262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 435/894] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/endpoints?service_id=68a3a34ca1cb406bbe6a8f5b7dd6af9b&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:35.165146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.196471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.198198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.198691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.199205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.200491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:35.201019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.202679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.222041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 460/895] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:35.229962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.254229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.292557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6437c15-5858-4c82-814d-2b61e5823f46 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.336157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fab92-a4be-4893-819c-74cd9f88c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.336984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fab92-a4be-4893-819c-74cd9f88c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.337596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fab92-a4be-4893-819c-74cd9f88c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.337929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fab92-a4be-4893-819c-74cd9f88c9b0 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.338932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fab92-a4be-4893-819c-74cd9f88c9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.340791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fab92-a4be-4893-819c-74cd9f88c9b0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.343247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.346821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5af273-840d-4623-8421-2f2f3ab3acb0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.355912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 436/896] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:15:35.355912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489ef77-4e4a-4498-8980-8a5fe1c28b97 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.355912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489ef77-4e4a-4498-8980-8a5fe1c28b97 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.355912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489ef77-4e4a-4498-8980-8a5fe1c28b97 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.355912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 437/897] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:35.357994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.358288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.358570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.377150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:35.378374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:35.401591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ba26c-0551-4de2-84fc-00bdec658410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.402249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ba26c-0551-4de2-84fc-00bdec658410 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.402534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ba26c-0551-4de2-84fc-00bdec658410 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.402815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ba26c-0551-4de2-84fc-00bdec658410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.465775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 438/898] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:35.485572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ba26c-0551-4de2-84fc-00bdec658410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.487167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ba26c-0551-4de2-84fc-00bdec658410 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.493097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.520043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.622028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 461/899] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:35.623942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578747-f9c1-42da-baf1-187360212f2f None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.624435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578747-f9c1-42da-baf1-187360212f2f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.624925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578747-f9c1-42da-baf1-187360212f2f None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.626747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 462/900] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:35.627580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd578747-f9c1-42da-baf1-187360212f2f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.629012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079cc2-65d2-4ac1-a8a8-8203de0a1e1e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.669339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.677380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.678467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.679102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.679385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.680350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.682514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a3ca6b36-74d3-4a49-81ee-f9162a27ccfa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:35.698143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:35.699101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:35.699944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:35.700711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 439/901] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:35.701625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.701918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.702196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.721724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:35.722902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:35.740698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd578747-f9c1-42da-baf1-187360212f2f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.764609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.783794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.784904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.785208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.785494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.797232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.798851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.799389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 440/902] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:35.800272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:35.817024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:35.817999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:35.818920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:35.818920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:35.818920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:35.818920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:35.823168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 463/903] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:35.824079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.920001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d114c77-4331-4c40-ac5d-8af40c5bf8b3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.932994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6583d6-aaa7-49a8-8773-3bf884e97da7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:35.943150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:35.956350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.957135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.957544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.957831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.958548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:35.958864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.960383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.969840 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 441/904] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:35.969840 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:35.973648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:35.974425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:35.974784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:35.975071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:35.975797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:35.977201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:35.992051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 464/905] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:35 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:36.004952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:36.044217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:36.104356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f20d-cc1e-4f8c-892f-10ea155e2f9d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.143131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44519754-8b5d-4d88-ab46-8606a7230c7a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.145342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.146399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.146927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.147416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.148421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:36.148960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.151368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.164678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 442/906] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:36.171933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:36.190226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.190899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.191188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.191473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.192289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:36.192602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.193974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.199662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 465/907] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:36.206629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:36.235272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:36.302929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d8ace-43ca-476c-bbf0-3157d12fb4fe None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.323439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:36.335094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303cac6-2d26-4a22-81e9-19e0d2f86fa4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.350030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.350858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.351354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.351637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.360873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.362819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.375571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.376413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.376801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.377182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.378071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] RBAC: Adding query filter params (interface=public, service_id=9d5e5f592a2e417191f6344c697d7f0f, region_id=RegionOne) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:36.378486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.379969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:36.381120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:36.382050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:36.382933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:36.383396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 443/908] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:36.389127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:36.390972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 466/909] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:36 2022] GET /identity/v3/endpoints?service_id=9d5e5f592a2e417191f6344c697d7f0f&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:36.397280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:36.520259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c63f82-7658-434a-af41-cff343a87462 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.524402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac258a5-167e-446c-8101-f2d85be20af8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.531498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:36.562502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.563343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.563730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.564137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.565100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:36.565528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.567101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.573232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c2b42-418c-4291-8f79-19989940a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.574174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c2b42-418c-4291-8f79-19989940a322 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.574605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c2b42-418c-4291-8f79-19989940a322 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.575036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c2b42-418c-4291-8f79-19989940a322 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.576545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c2b42-418c-4291-8f79-19989940a322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.578696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c2b42-418c-4291-8f79-19989940a322 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.591919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 444/911] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:36.591919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:36.592200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 467/911] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:36 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:15:36.705031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558dbd-f3c1-4f87-b86b-a18760f57dc7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:36.742129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:36.742812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:36.743100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:36.743382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:36.744849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] RBAC: Adding query filter params (role.id=90d233fd18d743618c346d3476fa7d7a, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=30d9ec9bc1514acdb359d5959e1597c6) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:36.745164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:36.746622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e9cde-28b3-4a1e-beef-aa1e70fda0cd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:36.753464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 445/912] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:36 2022] GET /identity/v3/role_assignments?user.id=30d9ec9bc1514acdb359d5959e1597c6&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=90d233fd18d743618c346d3476fa7d7a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:37.630500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a54b7-997c-4315-b3ef-dcc32802f574 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:37.631027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a54b7-997c-4315-b3ef-dcc32802f574 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:37.631142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a54b7-997c-4315-b3ef-dcc32802f574 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:37.632593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 468/913] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:37.638551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:37.639364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:37.639851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:37.657985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:37.659457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:37.687669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:37.733089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 446/914] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:37.756898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a54b7-997c-4315-b3ef-dcc32802f574 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:37.785854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:37.880836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a54b7-997c-4315-b3ef-dcc32802f574 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:37.921017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:37.922165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:37.922672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:37.923148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:37.924043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:37.925615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:37.938684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:37.939716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:15:37.940567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:37.943485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 469/915] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:37.949688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.049824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ec5c8-7821-4dc1-a4cf-72af8d70791e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:38.086014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:38.086684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.087268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.087760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.088564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:38.088876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:38.090230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84a29a-a8df-47d7-8fda-4d0fc96e460d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:38.095381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 447/916] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:38.100746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.198034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:38.215531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8470a-c622-4e8c-a726-c36c0c8d533f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:38.242664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f985928-4a8d-4f54-ab40-fef435dd304f None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.242975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f985928-4a8d-4f54-ab40-fef435dd304f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.243223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f985928-4a8d-4f54-ab40-fef435dd304f None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.246684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 448/917] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:38.252518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.253065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.253552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.256691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:38.257372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.257663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.257949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.258662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:38.258973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:38.260492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:38.266126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 470/918] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 16 00:15:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:38.272818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.273531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:38.275408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:38.302327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:38.363964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 449/919] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:38.387124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e09d4d-b2f8-44fe-b73f-12876233e69f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:38.388969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.443027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:38.443700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.444021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.444307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.445207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:38.447074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:38.479969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 471/920] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:38.512180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2ef28-cb5f-4f10-9b50-4fe38f2d49e8 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:38.560989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:38.562237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.562783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.563258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.564185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:38.565895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:38.579754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:38.580821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:38.581670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:38.590172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 450/921] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:38.592034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.653118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:38.705537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3267eca-43fb-4c31-b1b9-ae8e259ea7f2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:38.745479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:38.746498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.747008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.747502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.748447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:38.748956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:38.750542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f7c23-f198-4a62-8a9d-c1a07cb44420 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:38.762280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 472/922] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:38.766273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.788011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:38.886928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ac3d7-ef6c-4c50-84a8-c1cf2b8ccdfe None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:38.922348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239eb1-8c6e-486a-a893-a4ebff8bfd0d None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.922788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239eb1-8c6e-486a-a893-a4ebff8bfd0d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.923164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239eb1-8c6e-486a-a893-a4ebff8bfd0d None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.925868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 473/923] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:38.928367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:38.929262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.929735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.930075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a44d-2ae6-46f1-a5de-5d1d5316f12d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:38.930409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.930514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a44d-2ae6-46f1-a5de-5d1d5316f12d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:38.930771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a44d-2ae6-46f1-a5de-5d1d5316f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:38.932179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:38.932783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:38.934657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:38.940751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 451/924] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:38.948090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:38.955135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-49e5a44d-2ae6-46f1-a5de-5d1d5316f12d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:38.956359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-49e5a44d-2ae6-46f1-a5de-5d1d5316f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:39.022740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.034828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.036022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 474/925] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:39.037409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4936c-40f8-4289-a761-d1098e945293 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.037702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4936c-40f8-4289-a761-d1098e945293 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.037987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4936c-40f8-4289-a761-d1098e945293 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.043383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 475/926] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:39.044746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.045062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.045350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.073087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac9b03-8d84-4d21-894b-e41516b5d997 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.074449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:39.075643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:39.111239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.112238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.112524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.113526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.113639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] RBAC: Adding query filter params (interface=public, service_id=31611fd930504cdb8c3e0ec5e437d35f, region_id=RegionOne) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:39.113876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.115230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.121640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 452/927] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:38 2022] GET /identity/v3/endpoints?service_id=31611fd930504cdb8c3e0ec5e437d35f&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:39.126929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.156363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 476/928] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:39.156363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.240783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443db9-154e-4c10-8c18-474c765785ab None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.264224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93767-18dc-424c-9f67-710739cbab5b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.275838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.276625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.276918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.277205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.277866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.279232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.290666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:39.291986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:39.293182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:39.294049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 453/929] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:39.294909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.306889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.307174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.307777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.308092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.308460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.309218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.310745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.317472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 477/930] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:15:39.318230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.442429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434038-57f9-4e7d-94be-40939bfee541 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.452180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8160-d97d-41d7-98d7-b225de52aa18 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.484329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.485149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.485434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.485712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.502059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:39.503044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.503822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.504234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.504517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.505230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:39.505542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.506918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:39.511677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:39.512677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:39.513533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:39.514180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 454/931] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:39.516257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 478/932] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:39.520011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.523393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.594466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.605242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.645931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24324b-b726-4441-9107-4d45644c860d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.657895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34a9c-3197-4212-bc99-debece759f59 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.698255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.698650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.698946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.699235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.699518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.700193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.700313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:39.700582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.701003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.701475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.701962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.702632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:39.703148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.704833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.708586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 479/933] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:39.714408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.717338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 455/934] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:39.724979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:39.844566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8193b-1897-4ca4-9b38-9070126d8fcb None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.849644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b92b4-ca29-4811-83b2-5a3a666630fb None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:39.866792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.881921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:39.885500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.887192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.887637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.888120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.889012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.889533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:39.890400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:39.890763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:39.891091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.891218 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:39.904245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:39.905977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:39.920493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 480/935] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:39.930692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:39.932486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:39.933383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:39.933383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:39.933383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:39.933383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:39.934111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 456/936] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:39.939301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.067088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648610-105b-4297-af50-30321cd16e88 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:40.107069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:40.107069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.107069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.107403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.108079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:40.108400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:40.109786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:40.122964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 481/937] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:40.128553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.238937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23860-6b3e-423c-b9c8-17a5a0386815 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:40.274208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:40.275076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.275448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.275737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.283724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:40.285189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:40.300731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:40.301704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:40.302648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 457/938] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:40.309816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.348364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:40.416949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5272a9-e541-4024-a52b-ccb12e027222 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:40.453615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:40.454295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.454588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.454871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.455716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:40.456059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:40.457494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:40.475320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 482/939] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 00:15:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:40.481842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.531432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:40.597107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce1afb-4ef6-4bd3-8817-bbe0bceea6ca None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:40.633565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:40.634545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.634876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.635104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.646174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:40.647614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d307b2df-bd22-4004-842a-a9fb8a31266c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:40.665893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:40.666835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:40.667753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:40.667753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:40.667753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:40.667753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:40.667753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 458/940] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:40.676971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.781193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:40.790823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184b4a9-a4c9-46d2-9c77-04a2e1eab8c4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:40.797067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d823ff-693f-4e6b-977e-5e55a341ed26 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.797353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d823ff-693f-4e6b-977e-5e55a341ed26 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.797628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d823ff-693f-4e6b-977e-5e55a341ed26 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.798983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 459/941] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:40.804090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246c6b-4e77-4820-8679-81675343e949 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.804375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246c6b-4e77-4820-8679-81675343e949 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.804654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246c6b-4e77-4820-8679-81675343e949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.823154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-de246c6b-4e77-4820-8679-81675343e949 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:40.824384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-de246c6b-4e77-4820-8679-81675343e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:40.827863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:40.828562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:40.828852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:40.829138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:40.829920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:40.830238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:40.831613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:40.847993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 483/942] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:40.854205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.919972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 460/943] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:40.938052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de246c6b-4e77-4820-8679-81675343e949 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:40.967815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:40.987557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ec0ee-18ce-4871-948a-70ca338d5829 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.024261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.025532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.026019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.026535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.034447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.036332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:41.057045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:41.058014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:41.058890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:41.063212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de246c6b-4e77-4820-8679-81675343e949 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.069664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 484/944] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:41.071312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:41.085500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:41.110098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.110767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.111053 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.111330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.112072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.113577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.114942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING keystone.server.flask.common [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:15:41.136183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.sql.core [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:15:41.136183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:15:41.136183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [parameters: {'id': 'dad8f38b378543768ac02df73c3e7a5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:15:41.136183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dad8f38b378543768ac02df73c3e7a5d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dad8f38b378543768ac02df73c3e7a5d. Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:15:41.154523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application result.read() Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 00:15:41.155443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application yield resource Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise self.value Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application session.commit() Jun 16 00:15:41.156415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:15:41.157301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:15:41.158208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application result.read() Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:15:41.159006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [parameters: {'id': 'dad8f38b378543768ac02df73c3e7a5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.159903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:41.160705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dad8f38b378543768ac02df73c3e7a5d. Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.161604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 461/945] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 16 00:15:40 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:41.163547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:41.212808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb82a4-a9ee-4d11-a9cf-ed5dfc5194ce None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.252434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:41.260942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.261926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.262698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.263171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.264395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:41.265265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.267252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.274497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce933-55c6-4f08-b78d-af58329e3ba7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.284243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 485/946] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:41.291751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:41.322591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.323646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.323990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.324282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.334088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.336250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:41.354598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:41.355504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:41.356433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:41.363251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 462/947] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:41.364726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:41.379513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:41.414315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc51c52-176a-4645-ba47-204b69f355ef None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.451041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5aef3-897a-49f4-a9aa-f9da4fad49cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.451976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5aef3-897a-49f4-a9aa-f9da4fad49cd None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.452288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5aef3-897a-49f4-a9aa-f9da4fad49cd None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.452576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5aef3-897a-49f4-a9aa-f9da4fad49cd None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/30d9ec9bc1514acdb359d5959e1597c6/roles/90d233fd18d743618c346d3476fa7d7a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.454824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5aef3-897a-49f4-a9aa-f9da4fad49cd None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=30d9ec9bc1514acdb359d5959e1597c6, role_id=90d233fd18d743618c346d3476fa7d7a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.456301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5aef3-897a-49f4-a9aa-f9da4fad49cd None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.475977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 486/948] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:41 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/30d9ec9bc1514acdb359d5959e1597c6/roles/90d233fd18d743618c346d3476fa7d7a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:41.484064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec705ef-b43f-4d36-9ebb-9e13424702db None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.528583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.529307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.529591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.529869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.530742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:41.531055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.532630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2780fad-d98d-4607-836c-68864d250fbe None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.550727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:41.564442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 463/949] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:41.635022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a203-7860-4f3e-ac24-d0b501440654 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.635398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a203-7860-4f3e-ac24-d0b501440654 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.635898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a203-7860-4f3e-ac24-d0b501440654 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.637759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 487/950] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:41.643891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.644242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.644475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.663846 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:41.666388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:41.746048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 464/951] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:41.769911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a203-7860-4f3e-ac24-d0b501440654 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:41.893135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a203-7860-4f3e-ac24-d0b501440654 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:41.924855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:41.931669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:41.933093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:41.933383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:41.933664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:41.934329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:41.935729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:41.949947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:41.950951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:41.951791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 488/952] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:41.959924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:42.072301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a29ba-51ea-464b-8c18-58313ee69410 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:42.104532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:42.110897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:42.111578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.111867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.112337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.113136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:42.113452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:42.114834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927098-7fc9-401f-a2f4-f5515f0b0eb9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:42.120584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 465/953] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:42.128924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:42.224874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ccd70-814e-479a-b062-b4fe44bab305 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.225205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ccd70-814e-479a-b062-b4fe44bab305 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.225475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ccd70-814e-479a-b062-b4fe44bab305 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.227001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 466/954] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:42.232871 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.233167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.233459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.238929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b936f9-302c-49da-bb83-d450d369284c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:42.251944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:42.253148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:42.275979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:42.277050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.277561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.278038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.278939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:42.279443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:42.281053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:42.290429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 489/955] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:42.295672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:42.343972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 467/956] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:42.357212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:42.362212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:42.405127 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a2f6-855c-49b2-bed4-b4ea7ef6728d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:42.440836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:42.441857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.442370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.442878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.443831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:42.445475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:42.469931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 490/957] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:42.478795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23ab5-e070-4398-8dd5-2b973c91ebb7 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:42.512463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:42.533047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:42.533975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.534261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.534540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.535268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:42.536727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:42.550928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:42.552135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:42.553028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 468/958] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:42.565084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:42.677718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c206-f02e-4ecc-af49-a92c61c471ef None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:42.693960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:42.715130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:42.715796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.716261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.716655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.717403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:42.718051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:42.719742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168afc0a-2a1b-4f4e-ba10-b7114d2f9da3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:42.728654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 491/959] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:42.731800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:42.845736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd0216-b351-4d82-8f81-ae570215a622 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:42.885863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:42.886539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:42.886826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:42.887106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:42.887827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:42.888169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:42.889539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3451f2-8ff4-47fb-ad0c-14432b6243fb None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:42.894850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 469/960] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:43.819569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99643-64f7-4a48-9e61-da2b4ed383a9 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:43.820310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99643-64f7-4a48-9e61-da2b4ed383a9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:43.820310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99643-64f7-4a48-9e61-da2b4ed383a9 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:43.821717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 492/961] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:43.827074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:43.827571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:43.827739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:43.845674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:43.846836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9fcf-76ef-496b-8cb7-1d57bc48c637 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:43.847024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:43.847351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9fcf-76ef-496b-8cb7-1d57bc48c637 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:43.847858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9fcf-76ef-496b-8cb7-1d57bc48c637 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:43.850646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 493/962] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:43.857843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:43.858259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:43.858764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:43.881687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:43.883466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:43.902728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:43.929003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 470/963] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:43.953143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:43.958303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 494/964] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:43.990535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.072827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ff01c-19e7-4202-b590-bf20bdfff566 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.117245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471b3b-b550-4533-895f-59491ee1bb50 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.119800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.120835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.121124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.121406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.129859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.135202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:44.145563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:44.146492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:44.147324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:44.151982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 471/965] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 00:15:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:44.154120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.170587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.171420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.171833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.172182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.172907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.174647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:44.176782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING keystone.server.flask.common [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:15:44.194815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.sql.core [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:15:44.194815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:15:44.194815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [parameters: {'user_id': '25030b4477e440b99ea8a895039e06a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:15:44.194815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86570) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:15:44.204168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result.read() Jun 16 00:15:44.205459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:15:44.206316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application yield resource Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise self.value Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application session.commit() Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:15:44.207246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:15:44.209196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:15:44.210074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application result.read() Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:15:44.211670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [parameters: {'user_id': '25030b4477e440b99ea8a895039e06a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:44.214014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 00:15:44.215916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 495/966] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 16 00:15:43 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:44.218076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.286373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d138ed-abd7-4864-bbec-b22b18a774d9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.332018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.332638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.332928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.333212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.334140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:44.334455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.336492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:44.341196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346aced-e7cb-45d9-8653-6f96e5487f91 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.351782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 472/967] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:44.352692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.380715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.381853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.382500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.382983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.394195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.396753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:44.411259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:44.412235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:15:44.413247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:44.416023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 496/968] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:44.421336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.464605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.477441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.481521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758663c-8493-4a18-990d-48b89bb6c617 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.522064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.523023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.523405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.523783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.537470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.539223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:44.558331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f75a-91ce-4d1b-bf74-e66168804679 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:44.559793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:44.561214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:44.562227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:44.562227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:44.562227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:44.562227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:44.563044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 473/969] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:44.569270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.610225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.611146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.611610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.612174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.614262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:44.614738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.616365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdf98e-0703-4722-89ce-93b9483b9afe None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:44.676171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 497/970] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:44.700591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c6634-0afa-4b8d-8619-10aa705d0994 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.741554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.742247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.742532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.742812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.743578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:44.743900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.745342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:44.750245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6d25-9307-4553-9c8d-466909163a7e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.750561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6d25-9307-4553-9c8d-466909163a7e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.750809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6d25-9307-4553-9c8d-466909163a7e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.752730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 498/971] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:44.761889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.762208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.762446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.769338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 474/972] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:44.782420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.787914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:44.789478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:44.800946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.900626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 499/973] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:44.908263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980505b-34f0-41d3-9c0f-d30210c00876 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:44.919720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:44.942569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.960241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:44.961233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:44.961536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:44.961809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:44.973975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:44.976212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:45.002261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:45.003304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:45.004311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 475/974] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:45.012621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.078546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2ca31-5a5c-413e-82ce-54e55dcffb04 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.125616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.125824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.126631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.126920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.127251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.128057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.129462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:45.144614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:45.145658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:45.146489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 500/975] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:45.152423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.171522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44bc11-63c8-40bc-972b-6a2e6519c30d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.208404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.209324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.209607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.210072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.211396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:45.211754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.213876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ef7bc-86b6-4856-b965-e9a1593ba515 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.234029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 476/976] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:45.235935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73c8b8-ab9b-4af3-a3d1-560a7cf74eeb None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.236361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73c8b8-ab9b-4af3-a3d1-560a7cf74eeb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.236884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73c8b8-ab9b-4af3-a3d1-560a7cf74eeb None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.239003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 477/977] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:45.239661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.240518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73c8b8-ab9b-4af3-a3d1-560a7cf74eeb None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.260616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ab14d-50ea-4931-a8d2-3c3cad83e05c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.298012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.298690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.298983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.299266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.300045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:45.300359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.301748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7429e8-6b54-4db5-8049-1ed9f8c39508 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.307086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 501/978] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:45.308404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.308697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.308986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.326699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:45.327940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:45.360065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73c8b8-ab9b-4af3-a3d1-560a7cf74eeb None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.391297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.398479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.399152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.399430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.400291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.404004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 502/979] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:45.404796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.490206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.491752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.511659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.541454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229205b-ece8-4a73-82b1-3c2216d28998 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.577410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.578080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.578371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.578654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.579367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:45.579675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.581089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.585891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 503/980] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:45.586646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.605311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 478/981] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:45.606222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.635782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.686657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e20e5-33d3-4675-ba73-22339a78cebe None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.705577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475b1a-c872-4df1-839a-2d1d4d300b44 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.719566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.720391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.720681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.720966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.721690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.723058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.732092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.738027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 504/982] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:45 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:45.738901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.752247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.752945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.753243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.753525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.754365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] RBAC: Adding query filter params (interface=admin, service_id=31611fd930504cdb8c3e0ec5e437d35f, region_id=RegionOne) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:45.754685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.756501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.763352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 479/983] 10.222.0.39 () {56 vars in 1249 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/endpoints?service_id=31611fd930504cdb8c3e0ec5e437d35f&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:45.769131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:45.867820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d2c9-6e2e-467b-8884-482f866cb469 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.882431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:45.894656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26f7e-deab-42ca-b9da-40057da1b2e6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:45.915053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.916672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.916672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.916985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.927917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.929364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.936852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:45.937477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:45.938016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:45.938016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:45.939333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:45.940123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:45.947970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 480/984] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:45.954429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:45.955443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:45.956415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:45.956415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:45.956415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:45.956415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:45.956415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 505/985] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:45.956709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:46.069988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c2245-5929-4fc2-a881-d3066368aa18 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:46.110642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:46.111323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:46.111613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:46.112591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:46.112702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:46.112956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:46.114326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:46.127119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 481/986] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:46.132807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:46.192907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:46.241927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f617-f0f1-406f-ba06-ed89ed1228d5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:46.279115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:46.279949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:46.280354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:46.280645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:46.287552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:46.289044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:46.303534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:46.304634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:46.305559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:46.307966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 506/987] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:46.310889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:46.328578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:46.417231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc481f55-d36d-4b00-9b57-d7cbe05ce199 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:46.451719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:46.452338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:46.452630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:46.452914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:46.453710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:46.454027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:46.455457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ddc3b-0bb2-431b-8a53-156a36c15126 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:46.472966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 482/988] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:46.474755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:46.577360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3f41-84f2-458f-8212-a7d53dd33a82 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:46.591150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:46.613938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:46.614594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:46.614882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:46.615163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:46.616035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] RBAC: Adding query filter params (role.id=90d233fd18d743618c346d3476fa7d7a, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=30d9ec9bc1514acdb359d5959e1597c6) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:46.616352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:46.617786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba5a93-8ae1-4447-bb20-faa92b8d9c97 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:46.631973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 507/989] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:46 2022] GET /identity/v3/role_assignments?user.id=30d9ec9bc1514acdb359d5959e1597c6&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=90d233fd18d743618c346d3476fa7d7a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:47.897890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4cf84-5a72-482b-9011-a2deef1a7393 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:47.898410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4cf84-5a72-482b-9011-a2deef1a7393 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:47.898517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4cf84-5a72-482b-9011-a2deef1a7393 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:47.900058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 483/990] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:47.904971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719c9f6-334f-44ff-bd65-c2f7892d5db2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:47.905362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719c9f6-334f-44ff-bd65-c2f7892d5db2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:47.905543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719c9f6-334f-44ff-bd65-c2f7892d5db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:47.923862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e719c9f6-334f-44ff-bd65-c2f7892d5db2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:47.925060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e719c9f6-334f-44ff-bd65-c2f7892d5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:47.991992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 508/991] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:48.014641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4cf84-5a72-482b-9011-a2deef1a7393 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.104955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.113238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ac37-99dd-42b3-82d6-0d35af233320 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.113541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ac37-99dd-42b3-82d6-0d35af233320 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.113829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440ac37-99dd-42b3-82d6-0d35af233320 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.115360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 509/992] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:48.119940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.120234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.120514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.133243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4cf84-5a72-482b-9011-a2deef1a7393 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.136678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:48.137848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:48.168955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.169675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.169958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.170242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.170898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.172297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:48.189445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:48.190650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:48.191597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 484/993] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:48.197182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.224103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 510/994] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:48.238857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.276020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.304486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bcff4-a9c9-4367-8b17-405c46cf49d1 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.339902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.340563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.340854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.341390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.341841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:48.342151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.343523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.347515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360222b-5679-43ff-819b-1d5ade37ffde None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.348965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 485/995] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:48.355314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.358314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.389818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.390572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.391078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.391214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.391778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.393187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:48.405995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:48.407027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:48.407853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 511/996] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:48.413029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.469802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356c275-cc47-43f6-92f3-4d3d0cda9b11 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.504876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.505545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.505832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.506111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.506819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:48.507127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.508512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.519636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 486/997] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:48.520936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.521137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.524487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2985-96d8-457c-89e4-1585126caa1c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.565317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.565994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.566285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.566567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.567280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:48.567593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.569014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.579659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 512/998] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:48.580637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.602231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.640164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93735-97d4-4cbd-956a-e990adbca550 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.677115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.677773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.678058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.678600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.679115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] RBAC: Adding query filter params (interface=public, service_id=0b424198ab984cf78160c2ad722e52e3, region_id=RegionOne) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:48.679427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.680835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.685402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16b8a-6b6e-40bd-ad81-fb5bc68e5540 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.686103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 487/999] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/endpoints?service_id=0b424198ab984cf78160c2ad722e52e3&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:48.691604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.722120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.722807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.722987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.723258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.724133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:48.724323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.725651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.732177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 513/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:48.738025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:48.771709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.817548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094febae-3469-4f20-a0e9-a58046ff4e22 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.845945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:48.848543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b82de-f4ed-4199-a9c9-ed05574d5ee5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:48.853203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cfab3-d0e6-4913-81c2-1cb9b8c8f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.854035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cfab3-d0e6-4913-81c2-1cb9b8c8f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.854242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cfab3-d0e6-4913-81c2-1cb9b8c8f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.854457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cfab3-d0e6-4913-81c2-1cb9b8c8f7c3 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.855140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cfab3-d0e6-4913-81c2-1cb9b8c8f7c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.856536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cfab3-d0e6-4913-81c2-1cb9b8c8f7c3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.862766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 488/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:48 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:15:48.863984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337bc94-dc90-48a4-9288-0d1538755ba6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.864274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337bc94-dc90-48a4-9288-0d1538755ba6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.864553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337bc94-dc90-48a4-9288-0d1538755ba6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.867920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 489/1002] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:48.872880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.873194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.873466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.890540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:48.891334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:48.891629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:48.891829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:48.892051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:48.892705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:48.893099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:48.894125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:48.912830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 514/1003] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:15:48.983117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 490/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:49.006222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:49.114080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:49.129018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d6b7-d75d-42a8-9c16-f8371fa5f6d2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:49.162817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:49.163606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:49.163913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:49.164183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] PATH_INFO: `/v3/services/image` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:49.164833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:49.166968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:49.178502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:49.179477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:49.180336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 515/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 16 00:15:49 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:49.186297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:49.290837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4c33f-3298-4ca7-b324-3d9baab55ebe None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:49.311373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:49.327031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:49.327706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:49.328027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:49.328310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:49.329024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] RBAC: Adding query filter params (name=image) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:49.329338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:49.330693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0f9b-5286-440f-8621-54375f9a6f70 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:49.335796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 491/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:49.341228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:49.445508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a89f-30eb-4ac7-8e22-f21de9a03a10 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:49.481189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:49.481854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:49.482141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:49.482419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:49.483113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] RBAC: Adding query filter params (type=image) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:49.483419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:49.484824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a64bb-9e9c-403a-b608-d02b923fe342 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:49.494163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 516/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:51.051896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b0c5-31da-4c7b-976e-45b9bdc1be0e None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.052315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b0c5-31da-4c7b-976e-45b9bdc1be0e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.052493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b0c5-31da-4c7b-976e-45b9bdc1be0e None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.053995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 492/1008] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:51.060999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.061809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.062097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.069585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b01a4-2cb4-43b2-a4e0-47a3776ca3b5 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.069871 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b01a4-2cb4-43b2-a4e0-47a3776ca3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.070146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b01a4-2cb4-43b2-a4e0-47a3776ca3b5 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.072058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 493/1009] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:51.076660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.076954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.077234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.079786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:51.081014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:51.093481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:51.094929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:51.096127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:51.159969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 517/1010] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:51.167589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 494/1011] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:51.182036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.195374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.290926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb732f-7f33-499b-b087-6df77c29dc09 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.302230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd0552-8540-4ffa-856b-4a7695b862d8 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.317387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:51.329500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.330594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.330894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.331179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.332140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.334151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.340864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.341665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.341947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.342219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.343384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.344817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.346586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 495/1012] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:51.346838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:51.347780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:51.354233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 518/1013] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:51.355045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.355126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.368018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:51.465346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be33b7-7ab7-4fde-82ec-09628b69c039 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.468646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccae86-62d2-49f4-a060-8f5bbf5b6e66 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.503627 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39980-fbc9-4563-9c1a-edb8634c2356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.504413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39980-fbc9-4563-9c1a-edb8634c2356 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.504710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39980-fbc9-4563-9c1a-edb8634c2356 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.504995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39980-fbc9-4563-9c1a-edb8634c2356 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.505548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.505774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39980-fbc9-4563-9c1a-edb8634c2356 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.506217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.506510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.506802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.507136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39980-fbc9-4563-9c1a-edb8634c2356 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.507536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:51.507897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.509472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.519639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 519/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:51.520308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.543502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 496/1015] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:51 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:51.609037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:51.612729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aa00a-285b-4476-8895-cfef115f3ca4 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.613070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aa00a-285b-4476-8895-cfef115f3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.613411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aa00a-285b-4476-8895-cfef115f3ca4 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.614980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 497/1016] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:51.621231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.621536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.621810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.639048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7e485-87a9-46cd-bd78-6982877832a6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.639259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:51.640443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:51.670519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:51.677816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.678762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.679203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.679663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.680570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:51.681704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.683686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.689501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 520/1017] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 16 00:15:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:51.695234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.725448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 498/1018] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:51.750029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:51.808836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3999-c843-4271-840c-9420e30d7437 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.846120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7809-ed60-4be3-91cf-872ecf81a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.846893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7809-ed60-4be3-91cf-872ecf81a40d None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.847179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7809-ed60-4be3-91cf-872ecf81a40d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.847457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7809-ed60-4be3-91cf-872ecf81a40d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.848210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b7809-ed60-4be3-91cf-872ecf81a40d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.849790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b7809-ed60-4be3-91cf-872ecf81a40d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.855434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd76887-faf1-481d-b0e4-c0a91597fc77 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:51.858811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:51.880392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 521/1019] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:15:51.900333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a395b-b929-442d-a9e6-6dc703caff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:51.901224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a395b-b929-442d-a9e6-6dc703caff34 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:51.901423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a395b-b929-442d-a9e6-6dc703caff34 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:51.901712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a395b-b929-442d-a9e6-6dc703caff34 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:51.902471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a395b-b929-442d-a9e6-6dc703caff34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:51.903897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a395b-b929-442d-a9e6-6dc703caff34 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:51.921668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 499/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:51 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:15:53.754575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840fd72-9dd7-4edf-8bae-8b984c1a8a94 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:53.755141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840fd72-9dd7-4edf-8bae-8b984c1a8a94 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:53.755141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840fd72-9dd7-4edf-8bae-8b984c1a8a94 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:53.756717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 522/1021] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:53.761802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:53.762220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:53.762464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:53.780072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:53.781271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:53.798351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:53.863907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 500/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:53.888243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840fd72-9dd7-4edf-8bae-8b984c1a8a94 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:53.993111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840fd72-9dd7-4edf-8bae-8b984c1a8a94 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.028388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97538821-6f31-4517-b645-2e4f7976e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.029129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97538821-6f31-4517-b645-2e4f7976e78b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.029414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97538821-6f31-4517-b645-2e4f7976e78b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.029692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97538821-6f31-4517-b645-2e4f7976e78b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.031022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97538821-6f31-4517-b645-2e4f7976e78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.032542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97538821-6f31-4517-b645-2e4f7976e78b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.034492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 523/1023] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:54.040219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.094659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa67a-1e43-4d33-99d0-268acf80a4ed None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.095226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa67a-1e43-4d33-99d0-268acf80a4ed None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.095516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa67a-1e43-4d33-99d0-268acf80a4ed None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.097293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 524/1024] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:54.104530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7bf8-e730-4f2d-a9ac-bd55dcfc59e6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.104851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7bf8-e730-4f2d-a9ac-bd55dcfc59e6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.105115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7bf8-e730-4f2d-a9ac-bd55dcfc59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.123185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2bab7bf8-e730-4f2d-a9ac-bd55dcfc59e6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:54.124440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2bab7bf8-e730-4f2d-a9ac-bd55dcfc59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:54.155744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2534d-2135-4fb0-b741-a990824a3e7a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.185117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.193068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.193994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.194279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.194562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.195292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.196999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.199398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 525/1025] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:54.200751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a358e0-4a9b-423f-b144-91fa7119e50b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.201047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a358e0-4a9b-423f-b144-91fa7119e50b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.201334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a358e0-4a9b-423f-b144-91fa7119e50b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.202747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 526/1026] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:54.208123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.208534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.208824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.222138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 501/1027] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:15:54 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:54.225748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.227104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:54.229191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:54.230449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.302914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 527/1028] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:54.327531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.348775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5f3a-7f5b-4f17-8028-4f6b2fe6ca8f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.390736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.391537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.391822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.392127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] PATH_INFO: `/v3/services/image` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.392783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.394268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:54.407979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:54.409011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:54.409851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 502/1029] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:54.417921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.443656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366dcb-b171-4b7e-bf30-3ad025ae1e22 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.470521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.483247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.484102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.484395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.484740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.494942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.496265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:54.504263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:54.505209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:54.508646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 528/1030] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:54.512911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.534478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13a743-9e9c-4c79-92ee-1e0eb4d4c903 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.574227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.574831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.575121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.575409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.576159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:54.576474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.577845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.583922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 503/1031] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:54.589181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.628520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c70927-a365-430b-a9c8-e3cbcc46efe3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.666747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.667424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.667713 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.668025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.668772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:54.669083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.670454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.678693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 529/1032] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:54.684907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.695279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8362-7b1f-4b63-ba52-27889eeb2ff7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.725234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.733495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.734163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.734721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.735123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.735492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.736326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] RBAC: Adding query filter params (type=image) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:54.736663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.738771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.744975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 504/1033] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:54.750661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.804375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d076eb-e914-4567-b82c-15c6743f61a8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.842955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.843665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.844049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.844377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.856337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.858798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.865899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab77be-aae7-4a61-a79b-32861994b624 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:54.881493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:54.882433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:54.883343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:54.883343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:54.883343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:54.883343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:54.883576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 530/1034] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:54.889699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.907999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:54.908659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:54.908968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:54.909223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:54.910045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] RBAC: Adding query filter params (interface=public, service_id=2cf7adda9ec346c3aac433eb9459ec3c, region_id=RegionOne) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:54.910366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:54.911729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:54.917774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 505/1035] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/endpoints?service_id=2cf7adda9ec346c3aac433eb9459ec3c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:54.923822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:54.993186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:54.999441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:55.007990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff5a1-540d-49e2-a400-b34822f39d2f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:55.037748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa989b-4419-40bd-acbc-61b275a063c6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:55.047541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:55.048257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:55.048597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:55.048827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:55.049560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:55.049878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:55.051674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:55.069685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 531/1036] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:55.070771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:55.084225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:55.084904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:55.085189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:55.085471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:55.086136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:55.088075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:55.095200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 506/1037] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:54 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:15:55.189640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18733-17a4-4b8d-af2b-c844c7a7bdd5 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:55.226079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:55.226887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:55.227181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:55.227466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:55.236539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:55.238015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:55.253623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:55.254763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:15:55.255692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 532/1038] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:15:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:55.261346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:55.366098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4349e9d-729d-477b-8462-e007d7113939 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:55.391381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:55.403982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:55.404658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:55.404938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:55.405209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:55.406049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:55.406357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:55.407771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:55.430296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 507/1039] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:15:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:55.432620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:55.451562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:55.536839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc930a2-9e2a-4f5a-9251-86e17216bfe0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:55.571119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:55.571908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:55.572199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:55.572479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:55.642872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:55.644266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:55.662394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:55.749380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 533/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:15:55.750659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:55.856337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e375-3fbe-4e40-bf4e-f13778103f47 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:55.891237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:55.892052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:55.892353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:55.892637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:55.903426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:55.904839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:55.922947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:55.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:55.925062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:55.925062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:55.925062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:55.925062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:55.925693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 508/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:55.929743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.037367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c876ad3-203d-4be4-81ab-e7aeafdc1c83 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:56.061116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:56.080923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:56.081732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.082119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.082501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.083330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:56.083745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:56.085259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:56.102101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 534/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:56.103999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.135897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:56.208882 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991436c-4e5b-411d-b177-76452b5c046c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:56.244144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:56.244942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.245224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.245503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.252380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:56.253816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d2d07cde-219a-4da0-9261-117839c07ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:56.268026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:56.268952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:56.269847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 509/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:56.276753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.381857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352f0dc-70ee-4e2a-8668-46ce8a5ebb38 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:56.417014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:56.417678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.417963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.418242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.419020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:56.419327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:56.420772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:56.429155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73ed35-378d-4276-87ea-f0160cafa84f None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.429455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73ed35-378d-4276-87ea-f0160cafa84f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.429746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73ed35-378d-4276-87ea-f0160cafa84f None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.431761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 510/1044] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:56.433672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 535/1045] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:56.436971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.437267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.437551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.439799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.456342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:56.457525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:56.477063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:56.529564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 511/1046] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:56.545605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786547-86cb-422e-92cc-6f6d35d92c16 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:56.552107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.578483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:56.581667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:56.582327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.582646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.582901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.583736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] RBAC: Adding query filter params (role.id=90d233fd18d743618c346d3476fa7d7a, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=450a31adc83e4bf0a8b21c86806981a9) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:56.584087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:56.585520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:56.599905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 536/1047] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:56 2022] GET /identity/v3/role_assignments?user.id=450a31adc83e4bf0a8b21c86806981a9&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=90d233fd18d743618c346d3476fa7d7a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:56.675739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d01d6-f437-4dc0-a9cf-09310c484157 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:56.712853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:56.713557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.713849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.714132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.725996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:56.735196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:56.736219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:56.737046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 512/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:56.745215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.845376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:56.849010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6ecc-cdbb-4ded-87d4-8797e2ddae14 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:56.883317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:56.884664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:56.884956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:56.885241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:56.885984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:56.886296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:56.887670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:56.896384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 537/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:56.902801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:56.989149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:57.010061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153711c8-27b1-4bf3-9c10-da0868c78017 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.043650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a22c-2488-4ad7-b5ae-b1771872fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.044555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a22c-2488-4ad7-b5ae-b1771872fd41 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.044839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a22c-2488-4ad7-b5ae-b1771872fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.048347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a22c-2488-4ad7-b5ae-b1771872fd41 None admin] PATH_INFO: `/v3/users/6aeb2dd87bcd47349639acfa77d14d5a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.067559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5a22c-2488-4ad7-b5ae-b1771872fd41 None admin] RBAC: Authorizing `identity:get_user(user_id=6aeb2dd87bcd47349639acfa77d14d5a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.069055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5a22c-2488-4ad7-b5ae-b1771872fd41 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.070952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 513/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:56 2022] GET /identity/v3/users/6aeb2dd87bcd47349639acfa77d14d5a => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:57.076699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:57.178141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99bd0-bdde-4c42-8c0e-7f7196adb5e7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.216370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.217034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.217320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.217596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.248947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:57.256663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76eabd-240b-45ef-96e5-b2b7c054bd7b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.257214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76eabd-240b-45ef-96e5-b2b7c054bd7b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.257797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76eabd-240b-45ef-96e5-b2b7c054bd7b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.259553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 514/1051] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:15:57.264592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145402-c9d7-4660-be79-0884db475d2e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.264886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145402-c9d7-4660-be79-0884db475d2e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.265175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145402-c9d7-4660-be79-0884db475d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.283319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-66145402-c9d7-4660-be79-0884db475d2e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:57.284551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-66145402-c9d7-4660-be79-0884db475d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:57.289477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.291821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.357762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 515/1052] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:57.380519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145402-c9d7-4660-be79-0884db475d2e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:57.397463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 538/1053] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:57.398669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:57.454310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:57.467346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:57.487440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145402-c9d7-4660-be79-0884db475d2e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.511004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed802-7e51-4ded-84ea-9e92cf0d6d9d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.525552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.526789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.527227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.527657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] PATH_INFO: `/v3/services/image` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.528731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.530482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:57.542366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:57.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:15:57.544196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:57.546253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 516/1054] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 16 00:15:57 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:57.551805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.552057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:57.552737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.552984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.553266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.554464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] RBAC: Authorizing `identity:get_project(project_id=0d712d3077474854bcb8ba90e4051f43)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.555917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.557733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 539/1055] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:57 2022] GET /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:57.563536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:57.668942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffd4c6-ba9e-49aa-9b2a-b7ace6d54cce None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.669783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51595-6d45-4dd1-ba7b-9d8f2f285c79 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.700347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:57.707313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.708016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.708377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.708645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.709410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=0d712d3077474854bcb8ba90e4051f43, user.id=6aeb2dd87bcd47349639acfa77d14d5a) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:57.709725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.711157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.716281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.716962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.717252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.717537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.718256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] RBAC: Adding query filter params (name=image) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:57.718573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.719956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.721204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:57.730496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 517/1056] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:57.730699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 540/1057] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:57 2022] GET /identity/v3/role_assignments?user.id=6aeb2dd87bcd47349639acfa77d14d5a&scope.project.id=0d712d3077474854bcb8ba90e4051f43&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:57.732644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:57.842071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236ecab-658f-4137-ba61-078e7db97af8 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:57.878929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:57.879864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:57.880319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:57.880770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:57.881640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] RBAC: Adding query filter params (type=image) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:57.882094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:57.883604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a183-edc8-44d0-9634-3bc353fa05f0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:57.890198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 518/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:57.896322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:58.038681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669942-1cff-4604-aebc-112beab20048 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:58.084363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c29c-c1d6-4a31-9e71-778ec1e4c376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:58.085103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c29c-c1d6-4a31-9e71-778ec1e4c376 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:58.085313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c29c-c1d6-4a31-9e71-778ec1e4c376 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:58.085588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c29c-c1d6-4a31-9e71-778ec1e4c376 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:58.086325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0c29c-c1d6-4a31-9e71-778ec1e4c376 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:58.088386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0c29c-c1d6-4a31-9e71-778ec1e4c376 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:58.109468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 541/1059] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:15:58.854170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5c7b-d42b-4eda-9d18-68d5b0eb3f76 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:58.854731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5c7b-d42b-4eda-9d18-68d5b0eb3f76 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:58.854731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5c7b-d42b-4eda-9d18-68d5b0eb3f76 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:58.856145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 519/1060] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:58.861871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:58.862181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:58.862454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:58.880686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:58.881879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:58.933026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:58.962285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 542/1061] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:58.984970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb5c7b-d42b-4eda-9d18-68d5b0eb3f76 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:59.052892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:59.096463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb5c7b-d42b-4eda-9d18-68d5b0eb3f76 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:59.131074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:59.132085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.132542 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.132968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.143642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:59.152122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:59.153150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:59.159188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 520/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 00:15:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:59.160138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:59.264998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308574a2-6c64-45a9-ac77-9dcd5ff6a5f1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:59.299749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:59.300453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.300737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.301014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.301760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:59.302064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:59.303431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:59.312391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 543/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:15:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:59.318199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:59.420946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e2c8-2a92-4a74-ad46-9f770d90333a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:59.444202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:59.456642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:59.457434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.457716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.457989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.468749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:59.470219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:59.487727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:59.488904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:59.489831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:59.489831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:59.489831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:59.489831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:59.489831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 521/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:59.496515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:59.536808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:59.597335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff1b4-4598-4e9e-93bb-d7b82c7193c8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:59.630675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:59.631333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.631617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.631908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.632624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:59.632929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:59.634917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:59.646770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 544/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:59.652262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:59.752680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a0474-024a-490b-89c5-bb48270ede5a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:59.787064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:59.787857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.788168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.788446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.796681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:59.798103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-e0df4bb2-3015-4a9f-bd33-1eb580e1ea6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:59.811862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:59.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:15:59.813847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:15:59.816202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 522/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:15:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:59.818682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:59.917339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a3c6-cb4d-4f85-88bc-a85daa47b822 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.917860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a3c6-cb4d-4f85-88bc-a85daa47b822 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.917966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a3c6-cb4d-4f85-88bc-a85daa47b822 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.919376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 523/1067] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:59.920871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:59.924359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.924647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.924922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.926405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83aa74-3886-4bce-8943-3adf1dc416f9 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:59.941397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:59.942573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:59.961838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:59.963077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:59.963360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:59.963637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:59.964503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:59.964808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:59.966234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:59.971754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:59.984838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 545/1068] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:15:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:59.990296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.024114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 524/1069] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:16:00.039778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.097985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de6727-0b53-45f7-af96-e79f2389e369 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.133612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.134979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.135259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.135905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.145910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.147576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.162075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50587ee-cb33-41e3-aeca-8225be2eb017 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:00.166432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:00.167638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:00.168551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:00.168551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:00.168551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:00.168551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:00.168551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 546/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:00.173089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.184344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.205076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.205869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.206157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.206575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.218279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:00.225926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:00.226873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:00.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 525/1071] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:00.234451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.263751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.289584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c928fcc-74a0-4e7f-9549-27d028c072b7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.328553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.329221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.329505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.329782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.330506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:00.330811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.332205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2c09c-963a-40f2-ad61-f7a2c856fa11 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.344492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 547/1072] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:00.345996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861f489-c73a-49f4-9bf3-2304ca1d3211 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.346297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861f489-c73a-49f4-9bf3-2304ca1d3211 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.346580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861f489-c73a-49f4-9bf3-2304ca1d3211 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.347829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 548/1073] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:00.352198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861f489-c73a-49f4-9bf3-2304ca1d3211 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.353262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4981-c62d-4c83-b6c9-69f4d652ac86 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.388915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.389679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.389964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.390241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.390982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:00.391290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.392670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef6fb8-6ae2-41e1-b024-22e22f35f901 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.401113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 526/1074] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:00.402292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.402581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.402859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.418719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:00.419940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:00.420281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.455444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861f489-c73a-49f4-9bf3-2304ca1d3211 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.487042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 527/1075] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:00.488131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.494347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.495246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.495605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.495981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.505166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.506686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.507465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:00.521777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:00.522831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:00.523780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 549/1076] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:00.524323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.592970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ba4c9-418d-4818-9a06-99422e44a7e2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.621991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa9373-d2a3-45dc-abba-13c97d7af8fe None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.626688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.627555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.627843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.628169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] PATH_INFO: `/v3/users/6aeb2dd87bcd47349639acfa77d14d5a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.629669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] RBAC: Authorizing `identity:get_user(user_id=6aeb2dd87bcd47349639acfa77d14d5a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.631112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.632777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 528/1077] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/users/6aeb2dd87bcd47349639acfa77d14d5a => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:00.633614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.652408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.660714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.661453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.661811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.662156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.717755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.730509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.732004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.735019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060508c-a59f-42c4-b7f0-46e15b65a55c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.769800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.770463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.770750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.771031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.771818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:00.772165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.773812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.785732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 529/1078] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:00.786522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.839460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 550/1079] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:00.840352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.868897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.888621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411521ee-07e8-4634-be5d-1b5d1612da00 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.922380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.923247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.923536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.923818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.925032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] RBAC: Authorizing `identity:get_project(project_id=0d712d3077474854bcb8ba90e4051f43)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.926466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.928394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 530/1080] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:00.928971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:00.940574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45729cb5-d583-44fb-90df-266e27e5af50 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:00.946683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:00.975302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:00.976215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:00.976525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:00.976800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/450a31adc83e4bf0a8b21c86806981a9/roles/90d233fd18d743618c346d3476fa7d7a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:00.979974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=450a31adc83e4bf0a8b21c86806981a9, role_id=90d233fd18d743618c346d3476fa7d7a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:00.981403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:00.997758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 551/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:00 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/450a31adc83e4bf0a8b21c86806981a9/roles/90d233fd18d743618c346d3476fa7d7a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:00.997758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:01.044746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b89a-2587-496d-99f7-eff1457712da None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:01.089017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:01.090268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:01.090561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:01.090836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:01.104020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:01.105538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:01.116651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:01.124757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:01.125695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:01.126753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:01.126753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:01.126753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:01.126753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:01.126753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 531/1082] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:01.132024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:01.134540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afabb08-a7e1-4c0a-b931-9322491fa672 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:01.178504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af56a13-6d93-4131-93da-838080068d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:01.179394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af56a13-6d93-4131-93da-838080068d7d None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:01.179672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af56a13-6d93-4131-93da-838080068d7d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:01.179975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af56a13-6d93-4131-93da-838080068d7d None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43/users/6aeb2dd87bcd47349639acfa77d14d5a/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:01.181998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af56a13-6d93-4131-93da-838080068d7d None admin] RBAC: Authorizing `identity:create_grant(project_id=0d712d3077474854bcb8ba90e4051f43, user_id=6aeb2dd87bcd47349639acfa77d14d5a, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:01.183434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af56a13-6d93-4131-93da-838080068d7d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:01.198472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 552/1083] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:00 2022] PUT /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43/users/6aeb2dd87bcd47349639acfa77d14d5a/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:01.207391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:01.252834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf5c83-2212-4572-ba80-6dbe0da5ed94 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:01.292665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:01.293360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:01.293653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:01.293989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:01.294745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:01.295052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:01.296483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828485d-e46a-4fdd-b4a9-0d42e8c1b402 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:01.310373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 532/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:03.125935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0688-c333-494a-a09f-16733418067b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.126486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0688-c333-494a-a09f-16733418067b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.126486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0688-c333-494a-a09f-16733418067b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.127837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 553/1085] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:03.132989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8b4a-ea6a-4bfe-9eae-d7d588186ee1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.133424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8b4a-ea6a-4bfe-9eae-d7d588186ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.133557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8b4a-ea6a-4bfe-9eae-d7d588186ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.150446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0c8e8b4a-ea6a-4bfe-9eae-d7d588186ee1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:03.151620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0c8e8b4a-ea6a-4bfe-9eae-d7d588186ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:03.217226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 533/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:03.240852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0688-c333-494a-a09f-16733418067b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.343842 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0688-c333-494a-a09f-16733418067b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.346587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff1ed-e4fa-4f32-9245-4bce6811a83c None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.346888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff1ed-e4fa-4f32-9245-4bce6811a83c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.347177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff1ed-e4fa-4f32-9245-4bce6811a83c None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.348599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 534/1087] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:03.354154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.354455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.354740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.370960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:03.372179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:03.378573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.379769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.380084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.380360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.391635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:03.399684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:03.400934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 554/1088] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:03.406801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.418004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:03.422656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:03.441386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 535/1089] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:16:03.465279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.506490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd6dad-fc5a-4db9-b359-f494d87df494 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.539435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.540690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.541083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.541365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.542102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:03.542414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:03.543783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:03.551494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 555/1090] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:03.557404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.562736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8448-54e9-4c8e-a2e2-7b28eef35473 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.596767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.597478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.597768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.598043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.609230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:03.616833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:03.618048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:03.619463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 536/1091] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:03.624629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.633938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:03.667200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9395d-e9a1-427c-9c74-72bb3b5026b7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.669972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:03.700793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.701577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.701862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.702139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.715239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:03.718703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:03.732568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25d19-d098-4a75-a858-e3056fbccda7 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:03.738788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:03.739939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:03.741513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:03.741513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:03.741513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:03.741513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:03.741513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 556/1092] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:03.746736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.768856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.769527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.769818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.770102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.770849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:03.771159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:03.772604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:03.783070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 537/1093] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:03.788699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.848792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff226d2b-3fd8-4e84-8c34-829c4cc373bf None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.871072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:03.883265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.883996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.884285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.884567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.885283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:03.885593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:03.886960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:03.888391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f728-b5bf-49da-9b4d-31e1bfe42ce0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:03.897031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:03.898741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 557/1094] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:03.904943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:03.926338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:03.927206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:03.927492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:03.927772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] PATH_INFO: `/v3/users/6aeb2dd87bcd47349639acfa77d14d5a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:03.929006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6aeb2dd87bcd47349639acfa77d14d5a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:03.930422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:03.937251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 538/1095] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/users/6aeb2dd87bcd47349639acfa77d14d5a => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:03.938072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.006608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71ade-68e4-46e4-827d-242ea7168b73 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.042642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.043429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.043716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.044031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.044151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae1e00-2609-4698-b342-79169dd217c3 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.051566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.053046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:04.067896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:04.068968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:04.070257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 558/1096] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:04.074598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.082237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.082888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.083172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.083449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.118616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.127009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.153458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.154914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.174876 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4e872-9230-417a-af2f-3960a52ea123 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.207978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.208646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.208942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.209228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.210066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:04.210380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.211815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.230488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 559/1097] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:04.236161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.253311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 539/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:16:04.259586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.331674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.331861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.336313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d9162-63a8-4912-a651-72bfa8332430 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.357663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65646122-8e82-43ee-88e3-14fca8024fec None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.371691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64335292-ed52-4092-a37b-587383416539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.372310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64335292-ed52-4092-a37b-587383416539 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.372603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64335292-ed52-4092-a37b-587383416539 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.372888 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64335292-ed52-4092-a37b-587383416539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.393340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.394205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.394492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.394771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.395983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d712d3077474854bcb8ba90e4051f43)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.397413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.399406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 540/1099] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:04.405069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.438819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64335292-ed52-4092-a37b-587383416539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.440404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64335292-ed52-4092-a37b-587383416539 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.503371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb5ec2-10eb-4bb3-9c4f-109c35422eb0 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.533232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.537672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.538331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.538622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.538907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.539741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=0d712d3077474854bcb8ba90e4051f43, user.id=6aeb2dd87bcd47349639acfa77d14d5a) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:04.540198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.540380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 560/1100] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:16:04.541637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.542821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64335292-ed52-4092-a37b-587383416539 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.547834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 541/1101] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/role_assignments?user.id=6aeb2dd87bcd47349639acfa77d14d5a&scope.project.id=0d712d3077474854bcb8ba90e4051f43&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:04.657249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64335292-ed52-4092-a37b-587383416539 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.693980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.694787 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.695076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.695357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.706611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.708095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:04.727409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:04.729477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:04.730737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:04.730737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:04.730737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:04.730737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:04.730737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 561/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:04.735831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.745185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.837421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd84a-f283-4798-896c-f29602e73970 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:04.872514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:04.873180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:04.873466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:04.873744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:04.874464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:04.874776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:04.876171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:04.888527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 542/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:04.894057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:04.946382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:04.993702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db205adc-0b0f-4ada-a2e9-c8a33410cbe0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:05.026289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:05.027080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:05.027369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:05.027647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:05.034306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:05.035740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:05.050114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:05.050963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:05.051929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 562/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:05.057643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:05.122835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:05.156844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8d2f5-5dab-4abb-ad9f-3fc9f957befd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:05.190598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:05.191251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:05.191536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:05.191814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:05.192622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:05.192935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:05.194362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ea277-ae4c-4d53-9122-2b97fc0aa422 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:05.206722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 543/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:05.213242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:05.311048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acd18-e966-4029-9a8e-010f0f51f4ca None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:05.323573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:05.344624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:05.345274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:05.345561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:05.345841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:05.346673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] RBAC: Adding query filter params (role.id=90d233fd18d743618c346d3476fa7d7a, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=450a31adc83e4bf0a8b21c86806981a9) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:05.346986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:05.348525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ae7a-71e4-484f-94a2-6ab605ed6a4f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:05.355373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 563/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:05 2022] GET /identity/v3/role_assignments?user.id=450a31adc83e4bf0a8b21c86806981a9&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=90d233fd18d743618c346d3476fa7d7a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:06.690330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c800b-a3f5-41d0-8238-725a2fc3d0c9 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:06.690885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c800b-a3f5-41d0-8238-725a2fc3d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:06.690885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c800b-a3f5-41d0-8238-725a2fc3d0c9 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:06.692301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 544/1107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:06.697693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:06.698114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:06.698256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:06.714475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:06.715630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:06.780448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 564/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:16:06.804716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c800b-a3f5-41d0-8238-725a2fc3d0c9 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:06.904144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c800b-a3f5-41d0-8238-725a2fc3d0c9 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:06.929065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:06.937958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78be0a-3f1d-4375-a2e1-6fa6770726e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:06.938746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78be0a-3f1d-4375-a2e1-6fa6770726e1 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:06.939037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78be0a-3f1d-4375-a2e1-6fa6770726e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:06.939323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78be0a-3f1d-4375-a2e1-6fa6770726e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:06.940576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78be0a-3f1d-4375-a2e1-6fa6770726e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:06.941963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78be0a-3f1d-4375-a2e1-6fa6770726e1 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:06.943582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 545/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:06.949735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:07.044774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced160-92df-453a-8982-537edfdd3e2c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:07.053810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:07.079835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca171467-560b-461c-9b27-d200437807ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:07.080522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171467-560b-461c-9b27-d200437807ac None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:07.080806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171467-560b-461c-9b27-d200437807ac None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:07.081082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171467-560b-461c-9b27-d200437807ac None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:07.081788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca171467-560b-461c-9b27-d200437807ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:07.083212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca171467-560b-461c-9b27-d200437807ac None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:07.102403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 565/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:16:06 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:09.254652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b8460-168e-449d-9166-a35feee4a069 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:09.255200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b8460-168e-449d-9166-a35feee4a069 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:09.255200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b8460-168e-449d-9166-a35feee4a069 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:09.256631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 546/1111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:09.261889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:09.262309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:09.262461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:09.279459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:09.280669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:09.349558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 566/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:09.373613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b8460-168e-449d-9166-a35feee4a069 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:09.473185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b8460-168e-449d-9166-a35feee4a069 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:09.507154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:09.508027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:09.508316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:09.508595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] PATH_INFO: `/v3/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:09.510135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] RBAC: Authorizing `identity:get_role(role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:09.511488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:09.512880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 547/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:09 2022] GET /identity/v3/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:09.518578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:09.607044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:09.618593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdebd91-ecab-4c7a-98da-555be5d39825 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:09.652622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:09.653477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:09.653761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:09.654033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] PATH_INFO: `/v3/users/7ff57fcc2ff34ce7ba18da52bb951b3c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:09.667236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] RBAC: Authorizing `identity:get_user(user_id=7ff57fcc2ff34ce7ba18da52bb951b3c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:09.668704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:09.670343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 567/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:09 2022] GET /identity/v3/users/7ff57fcc2ff34ce7ba18da52bb951b3c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:09.676115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:09.738043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:09.777750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dda30f-8dd2-4234-9a8c-1149cd34beca None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:09.813043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:09.813689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:09.813977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:09.814258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:09.881429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:09.882805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:09.941780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:09.981666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 548/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:09.987669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:10.098526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700ab23-8b59-4fdc-872a-5453411eb63e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:10.132103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0eb7f-d219-4e7b-9386-e6ddbaf31996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:10.132894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0eb7f-d219-4e7b-9386-e6ddbaf31996 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:10.133177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0eb7f-d219-4e7b-9386-e6ddbaf31996 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:10.133455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0eb7f-d219-4e7b-9386-e6ddbaf31996 None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:10.135375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0eb7f-d219-4e7b-9386-e6ddbaf31996 None admin] RBAC: Authorizing `identity:get_project(project_id=0d712d3077474854bcb8ba90e4051f43)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:10.136830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0eb7f-d219-4e7b-9386-e6ddbaf31996 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:10.138514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 568/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:09 2022] GET /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:10.144548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:10.243005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edaee0-b742-4387-8f67-456bd0e6aeae None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:10.277016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:10.277660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:10.277945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:10.278226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:10.279046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] RBAC: Adding query filter params (role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=0d712d3077474854bcb8ba90e4051f43, user.id=7ff57fcc2ff34ce7ba18da52bb951b3c) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:10.279360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:10.280815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12793a7a-b430-4b5a-bb88-763e6cdd517f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:10.286140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 549/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:10 2022] GET /identity/v3/role_assignments?user.id=7ff57fcc2ff34ce7ba18da52bb951b3c&scope.project.id=0d712d3077474854bcb8ba90e4051f43&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:12.372915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5eea-0789-41a4-8e99-a0f1607d24ef None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:12.373437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5eea-0789-41a4-8e99-a0f1607d24ef None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:12.373437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5eea-0789-41a4-8e99-a0f1607d24ef None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:12.374753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 569/1118] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:12.379862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:12.380286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:12.380454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:12.397413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:12.398601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:12.418997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:12.466977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 550/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:12.489690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5eea-0789-41a4-8e99-a0f1607d24ef None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:12.508272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:12.589961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5eea-0789-41a4-8e99-a0f1607d24ef None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:12.622636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:12.623516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:12.623761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:12.624069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] PATH_INFO: `/v3/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:12.625549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] RBAC: Authorizing `identity:get_role(role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:12.626921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:12.628312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 570/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:12 2022] GET /identity/v3/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:12.635041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:12.732840 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a50cd-d5ab-466f-8c73-b5b386d66c0c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:12.766467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:12.767327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:12.767609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:12.767903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] PATH_INFO: `/v3/users/7ff57fcc2ff34ce7ba18da52bb951b3c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:12.769069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] RBAC: Authorizing `identity:get_user(user_id=7ff57fcc2ff34ce7ba18da52bb951b3c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:12.770486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:12.772126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 551/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:12 2022] GET /identity/v3/users/7ff57fcc2ff34ce7ba18da52bb951b3c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:12.778372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:12.860428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:12.875605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407466-bff6-4d86-beca-31f7518b272b None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:12.908623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e413b-30fd-47ad-96fc-6712ef5c58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:12.909470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e413b-30fd-47ad-96fc-6712ef5c58d5 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:12.909760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e413b-30fd-47ad-96fc-6712ef5c58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:12.910044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e413b-30fd-47ad-96fc-6712ef5c58d5 None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:12.911219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e413b-30fd-47ad-96fc-6712ef5c58d5 None admin] RBAC: Authorizing `identity:get_project(project_id=0d712d3077474854bcb8ba90e4051f43)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:12.912687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e413b-30fd-47ad-96fc-6712ef5c58d5 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:12.914360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 571/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:12 2022] GET /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:12.920268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:12.945123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:13.018089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b25e-677c-4207-958a-7dbea2f1b23a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:13.050459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b803ab-aac0-4525-962f-64bb9b998c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:13.051077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b803ab-aac0-4525-962f-64bb9b998c7d None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:13.051368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b803ab-aac0-4525-962f-64bb9b998c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:13.051648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b803ab-aac0-4525-962f-64bb9b998c7d None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43/users/7ff57fcc2ff34ce7ba18da52bb951b3c/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:13.053850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b803ab-aac0-4525-962f-64bb9b998c7d None admin] RBAC: Authorizing `identity:create_grant(project_id=0d712d3077474854bcb8ba90e4051f43, user_id=7ff57fcc2ff34ce7ba18da52bb951b3c, role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:13.055272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b803ab-aac0-4525-962f-64bb9b998c7d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:13.069455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 552/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:12 2022] PUT /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43/users/7ff57fcc2ff34ce7ba18da52bb951b3c/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:15.147979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb013e-33d9-4711-be9c-0e80038fd637 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:15.148514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb013e-33d9-4711-be9c-0e80038fd637 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:15.148621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb013e-33d9-4711-be9c-0e80038fd637 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:15.150551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 572/1124] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:15.155603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:15.156016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:15.156210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:15.173339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:15.174516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:15.239545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 553/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:15.262086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb013e-33d9-4711-be9c-0e80038fd637 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:15.361436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb013e-33d9-4711-be9c-0e80038fd637 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:15.393907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:15.394760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:15.395033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:15.395314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] PATH_INFO: `/v3/roles/bfcba544f0754672b9c2fddb4d7b118f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:15.396811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] RBAC: Authorizing `identity:get_role(role_id=bfcba544f0754672b9c2fddb4d7b118f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:15.398177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:15.400081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 573/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:15 2022] GET /identity/v3/roles/bfcba544f0754672b9c2fddb4d7b118f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:15.405612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:15.420268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:15.502612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711de019-6597-4e0a-87b6-18f678bbc23d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:15.537470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:15.538336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:15.538626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:15.538906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] PATH_INFO: `/v3/users/7ff57fcc2ff34ce7ba18da52bb951b3c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:15.540181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff57fcc2ff34ce7ba18da52bb951b3c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:15.541575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:15.543189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 554/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:15 2022] GET /identity/v3/users/7ff57fcc2ff34ce7ba18da52bb951b3c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:15.548828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:15.573093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:15.646618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2015d69-6853-404d-b365-d7bd5dc14de2 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:15.679563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:15.680236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:15.680602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:15.681413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:15.746682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:15.748146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:15.769473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:15.843914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 574/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:15.849920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:15.934736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:15.955045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefd5d0-0753-49c7-9708-1a27547320a2 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:15.989276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb2d0-243e-4d7c-a6e1-ee8122be3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:15.990115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb2d0-243e-4d7c-a6e1-ee8122be3f4f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:15.990397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb2d0-243e-4d7c-a6e1-ee8122be3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:15.990671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb2d0-243e-4d7c-a6e1-ee8122be3f4f None admin] PATH_INFO: `/v3/projects/0d712d3077474854bcb8ba90e4051f43` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:15.991828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb2d0-243e-4d7c-a6e1-ee8122be3f4f None admin] RBAC: Authorizing `identity:get_project(project_id=0d712d3077474854bcb8ba90e4051f43)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:15.993295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb2d0-243e-4d7c-a6e1-ee8122be3f4f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:15.995143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 555/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:15 2022] GET /identity/v3/projects/0d712d3077474854bcb8ba90e4051f43 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:16.001369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:16.100929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f8328-f48f-4a9f-9040-c7db05362575 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:16.123386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:16.135305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:16.135983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:16.136277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:16.136564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:16.137395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] RBAC: Adding query filter params (role.id=bfcba544f0754672b9c2fddb4d7b118f, scope.project.id=0d712d3077474854bcb8ba90e4051f43, user.id=7ff57fcc2ff34ce7ba18da52bb951b3c) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:16.137715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:16.139140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8089c0-04f7-443e-96f1-2d5bc216772e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:16.144879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 575/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:16 2022] GET /identity/v3/role_assignments?user.id=7ff57fcc2ff34ce7ba18da52bb951b3c&scope.project.id=0d712d3077474854bcb8ba90e4051f43&role.id=bfcba544f0754672b9c2fddb4d7b118f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:18.278167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839d6f5-5bcf-455d-8a89-3e38f698cfa6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:18.278688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839d6f5-5bcf-455d-8a89-3e38f698cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:18.278796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839d6f5-5bcf-455d-8a89-3e38f698cfa6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:18.280117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 556/1131] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:18.285234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:18.285627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:18.285808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:18.302721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:18.303843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:18.369104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 576/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:18.393035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839d6f5-5bcf-455d-8a89-3e38f698cfa6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:18.493636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839d6f5-5bcf-455d-8a89-3e38f698cfa6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:18.527538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f98507-9adc-4409-a33b-4519e0553ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:18.528343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98507-9adc-4409-a33b-4519e0553ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:18.528635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98507-9adc-4409-a33b-4519e0553ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:18.528913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98507-9adc-4409-a33b-4519e0553ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:18.530071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f98507-9adc-4409-a33b-4519e0553ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:18.531491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f98507-9adc-4409-a33b-4519e0553ad8 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:18.533118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 557/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:18.538994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:18.635334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f69f7d-91b2-495c-a7d7-0418c942e5f7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:18.651305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:18.669001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7be048-ad71-42cf-a671-60c3f1f19ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:18.669649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be048-ad71-42cf-a671-60c3f1f19ba1 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:18.669935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be048-ad71-42cf-a671-60c3f1f19ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:18.670215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be048-ad71-42cf-a671-60c3f1f19ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:18.670913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7be048-ad71-42cf-a671-60c3f1f19ba1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:18.672376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7be048-ad71-42cf-a671-60c3f1f19ba1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:18.697134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 577/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:16:18 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:20.865710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408abf6-ff13-4e2f-8e37-a2d2c8d3bf4d None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:20.866274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408abf6-ff13-4e2f-8e37-a2d2c8d3bf4d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:20.866274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408abf6-ff13-4e2f-8e37-a2d2c8d3bf4d None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:20.867622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 558/1135] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:20.874014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:20.874452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:20.874585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:20.891102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:20.892332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:20.957115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 578/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:20.982302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408abf6-ff13-4e2f-8e37-a2d2c8d3bf4d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:21.001303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:21.085151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408abf6-ff13-4e2f-8e37-a2d2c8d3bf4d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:21.119204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde929f-47c7-48fa-817f-80d130dc083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:21.119959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde929f-47c7-48fa-817f-80d130dc083f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:21.120250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde929f-47c7-48fa-817f-80d130dc083f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:21.120534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde929f-47c7-48fa-817f-80d130dc083f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:21.121707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde929f-47c7-48fa-817f-80d130dc083f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:21.123124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde929f-47c7-48fa-817f-80d130dc083f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:21.124773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 559/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:21.130524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:21.222933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:21.226768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f6a9-4f64-4c52-a07c-222b6503ad68 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:21.262305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1745fb-710e-491f-af5d-8c5056951824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:21.262964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1745fb-710e-491f-af5d-8c5056951824 None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:21.263256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1745fb-710e-491f-af5d-8c5056951824 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:21.263538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1745fb-710e-491f-af5d-8c5056951824 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:21.264268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1745fb-710e-491f-af5d-8c5056951824 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:21.265703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1745fb-710e-491f-af5d-8c5056951824 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:21.284867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 579/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:16:21 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:23.419990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2087d4-16d3-433f-ac08-105a76e1af82 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:23.420494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2087d4-16d3-433f-ac08-105a76e1af82 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:23.420494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2087d4-16d3-433f-ac08-105a76e1af82 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:23.421857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 560/1139] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:23.426838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:23.427275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:23.427408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:23.444283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:23.445456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:23.510352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 580/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:23.533982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2087d4-16d3-433f-ac08-105a76e1af82 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:23.620342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:23.636536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2087d4-16d3-433f-ac08-105a76e1af82 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:23.669694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:23.670528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:23.670765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:23.671047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:23.681393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:23.688945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:23.690035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:23.690928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 561/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:23.696620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:23.777160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:23.793180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7c0b-f97d-4d37-800d-1e51e99dedb2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:23.825771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:23.826426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:23.826712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:23.826992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:23.827732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:23.828080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:23.829443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:23.838018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 581/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:23.843663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:23.944494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710c9e0-d388-4035-8aea-c45c2e3cbd47 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:23.977910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:23.979506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:23.979793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:23.980100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] PATH_INFO: `/v3/users/8079f201a5b348aca66000bd48253215` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:23.992743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] RBAC: Authorizing `identity:get_user(user_id=8079f201a5b348aca66000bd48253215)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:23.994781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:23.996445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 562/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:23 2022] GET /identity/v3/users/8079f201a5b348aca66000bd48253215 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:24.002240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:24.099031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7591b5-beda-42df-a84d-2fe45b6b196a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:24.132470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:24.133124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:24.133413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:24.133873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:24.149129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:24.200237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:24.201625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:24.298262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 582/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:24.304336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:24.308388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:24.402790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b67fb5-9588-4794-a264-028caa0d654b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:24.436603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6c2d9-f01d-446e-a521-fcab8b07937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:24.437463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6c2d9-f01d-446e-a521-fcab8b07937a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:24.437753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6c2d9-f01d-446e-a521-fcab8b07937a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:24.438036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6c2d9-f01d-446e-a521-fcab8b07937a None admin] PATH_INFO: `/v3/projects/5353f64624e54bf8ac540a336a8659a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:24.439205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6c2d9-f01d-446e-a521-fcab8b07937a None admin] RBAC: Authorizing `identity:get_project(project_id=5353f64624e54bf8ac540a336a8659a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:24.440662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6c2d9-f01d-446e-a521-fcab8b07937a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:24.442352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 563/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:24 2022] GET /identity/v3/projects/5353f64624e54bf8ac540a336a8659a2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:24.448516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:24.494211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:24.546755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f6a22-338d-4866-9ab9-0443c632e139 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:24.580614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:24.581264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:24.581554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:24.581835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:24.582664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=5353f64624e54bf8ac540a336a8659a2, user.id=8079f201a5b348aca66000bd48253215) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:24.582982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:24.584450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffca90-2112-4256-9505-e1dbcb0e390d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:24.589824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 583/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:24 2022] GET /identity/v3/role_assignments?user.id=8079f201a5b348aca66000bd48253215&scope.project.id=5353f64624e54bf8ac540a336a8659a2&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:26.673242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783efc5-8812-436d-abf6-a27863917f51 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:26.673796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783efc5-8812-436d-abf6-a27863917f51 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:26.673796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783efc5-8812-436d-abf6-a27863917f51 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:26.675167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 564/1147] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:26.680236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:26.681313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:26.681415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:26.698222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:26.699381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:26.763500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 584/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:26.785744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783efc5-8812-436d-abf6-a27863917f51 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:26.854831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:26.885011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783efc5-8812-436d-abf6-a27863917f51 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:26.917921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:26.918693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:26.918977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:26.919255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:26.929047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:26.936931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:26.938012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:26.939061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 565/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:26.944262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:26.985591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:27.041623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26cb9e-e957-4fa3-8ba2-3e841ee25738 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:27.075399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:27.076095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:27.076381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:27.076659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:27.077396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:27.077702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:27.079060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:27.086999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 585/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:27.092707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:27.189543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bed89e-cdec-46ea-8d12-bc2fcc8e7bbb None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:27.217278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:27.222614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:27.223476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:27.223762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:27.224071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] PATH_INFO: `/v3/users/8079f201a5b348aca66000bd48253215` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:27.225241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] RBAC: Authorizing `identity:get_user(user_id=8079f201a5b348aca66000bd48253215)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:27.226653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:27.228535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 566/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:27 2022] GET /identity/v3/users/8079f201a5b348aca66000bd48253215 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:27.234586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:27.331392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c09a01-9034-4757-a6d3-f2d484f6cfe3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:27.332886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:27.363492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa7a62-b852-4536-9b93-15fa6b1b7269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:27.364433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa7a62-b852-4536-9b93-15fa6b1b7269 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:27.364716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa7a62-b852-4536-9b93-15fa6b1b7269 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:27.364992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa7a62-b852-4536-9b93-15fa6b1b7269 None admin] PATH_INFO: `/v3/projects/5353f64624e54bf8ac540a336a8659a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:27.366144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa7a62-b852-4536-9b93-15fa6b1b7269 None admin] RBAC: Authorizing `identity:get_project(project_id=5353f64624e54bf8ac540a336a8659a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:27.367562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa7a62-b852-4536-9b93-15fa6b1b7269 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:27.369812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 586/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:27 2022] GET /identity/v3/projects/5353f64624e54bf8ac540a336a8659a2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:27.375734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:27.474490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618b949-1c6b-4734-9b47-d64fab7cb288 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:27.508081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18749e40-b4bd-4e69-a14d-dcaf43a559a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:27.509981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749e40-b4bd-4e69-a14d-dcaf43a559a5 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:27.510268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749e40-b4bd-4e69-a14d-dcaf43a559a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:27.510549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749e40-b4bd-4e69-a14d-dcaf43a559a5 None admin] PATH_INFO: `/v3/projects/5353f64624e54bf8ac540a336a8659a2/users/8079f201a5b348aca66000bd48253215/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:27.512528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18749e40-b4bd-4e69-a14d-dcaf43a559a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5353f64624e54bf8ac540a336a8659a2, user_id=8079f201a5b348aca66000bd48253215, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:27.513944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18749e40-b4bd-4e69-a14d-dcaf43a559a5 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:27.527226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 567/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:27 2022] PUT /identity/v3/projects/5353f64624e54bf8ac540a336a8659a2/users/8079f201a5b348aca66000bd48253215/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:29.611782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44322b-4ee2-4218-b7de-f143aff5db7a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:29.612448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44322b-4ee2-4218-b7de-f143aff5db7a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:29.612448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44322b-4ee2-4218-b7de-f143aff5db7a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:29.613746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 587/1154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:29.619444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:29.619902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:29.620034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:29.636942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:29.638117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:29.692098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:29.704766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 568/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:29.728269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44322b-4ee2-4218-b7de-f143aff5db7a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:29.830139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44322b-4ee2-4218-b7de-f143aff5db7a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:29.863128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:29.863854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:29.864171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:29.864450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:29.875703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:29.883205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:29.884757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:29.885710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 588/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:29.890846 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:29.990004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed407d73-5b27-48f2-bce0-836d33adcaf1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.025484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.026148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.026438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.026718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.027466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:30.027775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.029175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.036982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 569/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:30.043376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.073301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.142499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71cd6c-2e66-407b-8446-cff83b58fe27 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.176390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.177246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.177532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.177810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] PATH_INFO: `/v3/users/8079f201a5b348aca66000bd48253215` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.178980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] RBAC: Authorizing `identity:get_user(user_id=8079f201a5b348aca66000bd48253215)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.180677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.182390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 589/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:30 2022] GET /identity/v3/users/8079f201a5b348aca66000bd48253215 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:30.188341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.240675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.285555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427566fa-6b04-4321-856d-36bd05381105 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.318186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.318827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.319114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.319394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.385154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.386602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.438216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.485485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 570/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:30.491287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.582382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.586356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf801e09-d90b-42d3-9d7f-1f78cb65d838 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.622176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f64cef-e31f-42b1-8132-91162d0a0775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.623004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64cef-e31f-42b1-8132-91162d0a0775 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.623286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64cef-e31f-42b1-8132-91162d0a0775 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.623562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64cef-e31f-42b1-8132-91162d0a0775 None admin] PATH_INFO: `/v3/projects/5353f64624e54bf8ac540a336a8659a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.624743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f64cef-e31f-42b1-8132-91162d0a0775 None admin] RBAC: Authorizing `identity:get_project(project_id=5353f64624e54bf8ac540a336a8659a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.626164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f64cef-e31f-42b1-8132-91162d0a0775 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.627814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 590/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:30 2022] GET /identity/v3/projects/5353f64624e54bf8ac540a336a8659a2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:30.634529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.730821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b95ae-3cb8-4a99-9e5c-6e928ae75efd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.764306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.764951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.765240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.765524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.766346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=5353f64624e54bf8ac540a336a8659a2, user.id=8079f201a5b348aca66000bd48253215) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:30.766661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.768105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262116fa-2934-4804-8fa0-027bee980591 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.773746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 571/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:30 2022] GET /identity/v3/role_assignments?user.id=8079f201a5b348aca66000bd48253215&scope.project.id=5353f64624e54bf8ac540a336a8659a2&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:32.910251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db52d-3a01-4d15-be9f-da8d04d7a470 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:32.910807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db52d-3a01-4d15-be9f-da8d04d7a470 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:32.910807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db52d-3a01-4d15-be9f-da8d04d7a470 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:32.912225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 591/1162] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:32.917991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:32.918425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:32.918551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:32.935480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:32.936710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:32.947138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:33.002854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 572/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:33.025891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db52d-3a01-4d15-be9f-da8d04d7a470 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:33.125081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db52d-3a01-4d15-be9f-da8d04d7a470 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:33.157507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:33.158147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.158435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.158715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.190580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:33.224212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:33.225647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:33.318861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 592/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:33.324868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:33.420245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24be05e-240e-48a7-a38d-f50e7d752faa None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:33.453373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:33.454106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.454388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.454663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.461124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:33.462830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d62d79ff-5399-4a2b-9542-99abbb95f16b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:33.477798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:33.479045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:33.480375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 573/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:16:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:33.485043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:33.547836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:33.582457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31661f3-c0c7-45d9-a537-9663c8cd405e None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:33.615826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:33.616518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.616808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.617087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.618375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:33.618707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:33.620107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8608f24-8d44-43ff-be0c-5f98bcc36343 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:33.627062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 593/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 16 00:16:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:35.719314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28c87-b8ee-453d-ac93-0a933c91f66f None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.719899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28c87-b8ee-453d-ac93-0a933c91f66f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.719899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28c87-b8ee-453d-ac93-0a933c91f66f None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.721270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 574/1167] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:35.726394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69354fb-a015-4c30-a908-5176d602c21d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.726794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69354fb-a015-4c30-a908-5176d602c21d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.726955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69354fb-a015-4c30-a908-5176d602c21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.746507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f69354fb-a015-4c30-a908-5176d602c21d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:35.747682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f69354fb-a015-4c30-a908-5176d602c21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:35.811296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 594/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:35.834756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a28c87-b8ee-453d-ac93-0a933c91f66f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.844377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.934601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a28c87-b8ee-453d-ac93-0a933c91f66f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:35.966644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea766e8-c346-4e88-97ce-0364709724b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:35.967294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea766e8-c346-4e88-97ce-0364709724b6 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.967577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea766e8-c346-4e88-97ce-0364709724b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.967852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea766e8-c346-4e88-97ce-0364709724b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.968611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea766e8-c346-4e88-97ce-0364709724b6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:35.970010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea766e8-c346-4e88-97ce-0364709724b6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.984673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 575/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Thu Jun 16 00:16:35 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:38.123213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4bc81-1533-413d-840b-4c3661928ce4 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.123748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4bc81-1533-413d-840b-4c3661928ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.123846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4bc81-1533-413d-840b-4c3661928ce4 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.125184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 595/1170] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:38.130564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.130966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.131140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.148590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:38.150384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:38.210879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:38.220120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 576/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:38.244229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4bc81-1533-413d-840b-4c3661928ce4 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.301621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:38.344084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4bc81-1533-413d-840b-4c3661928ce4 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.377725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943fda4-5446-478a-88e9-a76cd984a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.378578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943fda4-5446-478a-88e9-a76cd984a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.378865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943fda4-5446-478a-88e9-a76cd984a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.379144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943fda4-5446-478a-88e9-a76cd984a3b2 None admin] PATH_INFO: `/v3/domains/d1c9ce6134864c13b09c453ad10c0719` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.390245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943fda4-5446-478a-88e9-a76cd984a3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1c9ce6134864c13b09c453ad10c0719)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:38.391680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943fda4-5446-478a-88e9-a76cd984a3b2 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:38.393339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 596/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/domains/d1c9ce6134864c13b09c453ad10c0719 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:38.399361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.494544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92ba9-371a-4d01-b50a-b909f9f27f1d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.527059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7b082-e76c-4e39-8060-68331641dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.527700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7b082-e76c-4e39-8060-68331641dc35 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.528018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7b082-e76c-4e39-8060-68331641dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.528294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7b082-e76c-4e39-8060-68331641dc35 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.528994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7b082-e76c-4e39-8060-68331641dc35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:38.530399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7b082-e76c-4e39-8060-68331641dc35 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:38.555826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 577/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:16:38 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:40.712330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aa748-af7e-44d8-8db5-12e2d938e98e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:40.712924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aa748-af7e-44d8-8db5-12e2d938e98e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:40.712924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27aa748-af7e-44d8-8db5-12e2d938e98e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:40.714247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 597/1174] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:40.719468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:40.719910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:40.720083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:40.737892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:40.739076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:40.784930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:40.809350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 578/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:40.833467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27aa748-af7e-44d8-8db5-12e2d938e98e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:40.933492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27aa748-af7e-44d8-8db5-12e2d938e98e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:40.952366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:40.967105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e02f9-df2b-4402-8462-6c455c6e0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:40.967920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e02f9-df2b-4402-8462-6c455c6e0797 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:40.968213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e02f9-df2b-4402-8462-6c455c6e0797 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:40.968495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e02f9-df2b-4402-8462-6c455c6e0797 None admin] PATH_INFO: `/v3/domains/d1c9ce6134864c13b09c453ad10c0719` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:40.969667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e02f9-df2b-4402-8462-6c455c6e0797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1c9ce6134864c13b09c453ad10c0719)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:40.971108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e02f9-df2b-4402-8462-6c455c6e0797 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:40.972754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 598/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 16 00:16:40 2022] GET /identity/v3/domains/d1c9ce6134864c13b09c453ad10c0719 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:40.978569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:41.074599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b27f1-ad74-4065-aa17-2fe2a957cce4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:41.108046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b497-c858-4178-b843-df7cc6289865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:41.108712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b497-c858-4178-b843-df7cc6289865 None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:41.109000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b497-c858-4178-b843-df7cc6289865 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:41.109280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b497-c858-4178-b843-df7cc6289865 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:41.109987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b497-c858-4178-b843-df7cc6289865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:41.111402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b497-c858-4178-b843-df7cc6289865 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:41.133059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 579/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:16:40 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:43.309656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9ca6-40ec-40a1-ba7c-cb57131c347b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.310173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9ca6-40ec-40a1-ba7c-cb57131c347b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.310173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e9ca6-40ec-40a1-ba7c-cb57131c347b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.311620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 599/1178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:43.316857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.317240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.317433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.335553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:43.337459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:43.363527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.404097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 580/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:43.427319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9ca6-40ec-40a1-ba7c-cb57131c347b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.532405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e9ca6-40ec-40a1-ba7c-cb57131c347b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.564646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.565369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.565660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.565941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.577019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:43.584629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:43.585743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:43.586823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 600/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:43.591763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.690630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13916223-c0c8-4b29-84f0-82bd04d36ea3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.724054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.724710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.724998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.725280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.726027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:43.726341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.728399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:43.736495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 581/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:43.742069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.791228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.840763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c052023-0543-433e-86e3-277953ae75e8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.873388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.874234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.874521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.874795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] PATH_INFO: `/v3/users/cf86c9a3ba074b088afa318ea83b0d75` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.888332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] RBAC: Authorizing `identity:get_user(user_id=cf86c9a3ba074b088afa318ea83b0d75)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.889756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:43.891370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 601/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/users/cf86c9a3ba074b088afa318ea83b0d75 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:43.897150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.924561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.995283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984635-5040-444d-a613-c285bea4cddd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.027006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.027635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.027944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.028222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.092640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.094006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.119633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.190565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 582/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:44.196424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.299031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72a732-9a7b-42a8-95c1-9fe500511381 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.306131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.332003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8349-c826-4339-bf60-2cf5cbcfaff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.332859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8349-c826-4339-bf60-2cf5cbcfaff1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.333149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8349-c826-4339-bf60-2cf5cbcfaff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.333431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8349-c826-4339-bf60-2cf5cbcfaff1 None admin] PATH_INFO: `/v3/projects/c13570c1c1b34e468c99de23d788a795` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.334621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8349-c826-4339-bf60-2cf5cbcfaff1 None admin] RBAC: Authorizing `identity:get_project(project_id=c13570c1c1b34e468c99de23d788a795)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.336087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8349-c826-4339-bf60-2cf5cbcfaff1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.338313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 602/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/projects/c13570c1c1b34e468c99de23d788a795 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:44.344624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.441500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94df7c-8491-4f30-b9ca-041acdc1c7b6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.466510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.475411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.476087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.476375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.476656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.478098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c13570c1c1b34e468c99de23d788a795, user.id=cf86c9a3ba074b088afa318ea83b0d75) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:44.478508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.480222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b3143-c47d-4239-8f24-1d6cc255dd29 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.485520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 583/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/role_assignments?user.id=cf86c9a3ba074b088afa318ea83b0d75&scope.project.id=c13570c1c1b34e468c99de23d788a795&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:46.640942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1623a-3948-45e9-a63a-2217e0a2678e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:46.641473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1623a-3948-45e9-a63a-2217e0a2678e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:46.641473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1623a-3948-45e9-a63a-2217e0a2678e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:46.642852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 603/1186] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:46.648212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:46.648609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:46.648819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:46.666320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:46.667502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:46.734464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 584/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:46.756712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1623a-3948-45e9-a63a-2217e0a2678e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:46.855360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1623a-3948-45e9-a63a-2217e0a2678e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:46.887945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:46.888727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:46.889010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:46.889285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:46.899659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:46.907147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:46.908249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:16:46.909080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 604/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:46.914785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.011955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654231c-351e-46f7-b1c2-30fa0333416d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.031962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.045938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.046606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.046897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.047185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.047962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:47.048279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.049633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.057905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 585/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:47.063561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.098830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.161922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34c8f9-9836-4306-bb9e-e82badcd13a0 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.193174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.194050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.194337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.194613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] PATH_INFO: `/v3/users/cf86c9a3ba074b088afa318ea83b0d75` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.196316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cf86c9a3ba074b088afa318ea83b0d75)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.197888 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.199480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 605/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:47 2022] GET /identity/v3/users/cf86c9a3ba074b088afa318ea83b0d75 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:47.205258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.304265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bde915-bbf7-41db-9e42-295ba88dde6e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.338252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30509795-7212-474e-b4ae-b8a203dfa20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.339109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509795-7212-474e-b4ae-b8a203dfa20a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.339394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509795-7212-474e-b4ae-b8a203dfa20a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.339671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509795-7212-474e-b4ae-b8a203dfa20a None admin] PATH_INFO: `/v3/projects/c13570c1c1b34e468c99de23d788a795` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.340860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30509795-7212-474e-b4ae-b8a203dfa20a None admin] RBAC: Authorizing `identity:get_project(project_id=c13570c1c1b34e468c99de23d788a795)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.342277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30509795-7212-474e-b4ae-b8a203dfa20a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.343976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 586/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:47 2022] GET /identity/v3/projects/c13570c1c1b34e468c99de23d788a795 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:47.349885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.447514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4b56-2904-45b7-9c3c-5d6aeeefb4b1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.448979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.482939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f1697-7242-4c98-9bf1-dadb88d54fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.483814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1697-7242-4c98-9bf1-dadb88d54fab None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.484137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1697-7242-4c98-9bf1-dadb88d54fab None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.484419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1697-7242-4c98-9bf1-dadb88d54fab None admin] PATH_INFO: `/v3/projects/c13570c1c1b34e468c99de23d788a795/users/cf86c9a3ba074b088afa318ea83b0d75/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.486368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f1697-7242-4c98-9bf1-dadb88d54fab None admin] RBAC: Authorizing `identity:create_grant(project_id=c13570c1c1b34e468c99de23d788a795, user_id=cf86c9a3ba074b088afa318ea83b0d75, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.487836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f1697-7242-4c98-9bf1-dadb88d54fab None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.500481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 606/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:47 2022] PUT /identity/v3/projects/c13570c1c1b34e468c99de23d788a795/users/cf86c9a3ba074b088afa318ea83b0d75/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:49.581642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339f32-16fa-443a-8b54-fbd384e9ff9c None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.582195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339f32-16fa-443a-8b54-fbd384e9ff9c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.582195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339f32-16fa-443a-8b54-fbd384e9ff9c None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.583587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 587/1193] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:49.589228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.589652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.589798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.607158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:49.608422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:49.673052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 607/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:16:49.695797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc339f32-16fa-443a-8b54-fbd384e9ff9c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.745596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:49.795944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc339f32-16fa-443a-8b54-fbd384e9ff9c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.827847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.828658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.828945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.829224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.839790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:49.847251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:49.848357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:16:49.849576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 588/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:49.854880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.942567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:49.951964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc736ca-8740-4ed2-bd49-3778761e251a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.984435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.985094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.985382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.985659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.986396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:49.986703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:49.988095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:49.996567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 608/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:50.002248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:50.099047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7769-be58-4cab-b61b-c79bc172c0dd None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:50.109620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:50.133131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:50.134129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:50.134414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:50.134691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] PATH_INFO: `/v3/users/cf86c9a3ba074b088afa318ea83b0d75` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:50.135911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] RBAC: Authorizing `identity:get_user(user_id=cf86c9a3ba074b088afa318ea83b0d75)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:50.137347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:50.139638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 589/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 16 00:16:50 2022] GET /identity/v3/users/cf86c9a3ba074b088afa318ea83b0d75 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:50.145811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:50.241451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0fe2e-c132-4f10-a951-0ed1df593e0d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:50.273485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:50.274878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:50.275162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:50.275442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:50.303433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:50.345670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:50.347115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:50.441236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 609/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:50.447215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:50.546097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df3ce5-9641-4734-8773-823240aae618 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:50.577687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13425a5-9f75-486c-a91f-ce0257d8d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:50.578537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13425a5-9f75-486c-a91f-ce0257d8d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:50.578821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13425a5-9f75-486c-a91f-ce0257d8d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:50.579099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13425a5-9f75-486c-a91f-ce0257d8d3f2 None admin] PATH_INFO: `/v3/projects/c13570c1c1b34e468c99de23d788a795` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:50.580284 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13425a5-9f75-486c-a91f-ce0257d8d3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c13570c1c1b34e468c99de23d788a795)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:50.581698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13425a5-9f75-486c-a91f-ce0257d8d3f2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:50.583376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 590/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 16 00:16:50 2022] GET /identity/v3/projects/c13570c1c1b34e468c99de23d788a795 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:50.590117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:50.644446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:50.687453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe15002-deb5-450b-923f-099641113ca7 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:50.719727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:50.720336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:50.720618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:50.720892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:50.721709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c13570c1c1b34e468c99de23d788a795, user.id=cf86c9a3ba074b088afa318ea83b0d75) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:50.722019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:50.723432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d653-80ea-4594-b039-317026fc548b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:50.729929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 610/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:50 2022] GET /identity/v3/role_assignments?user.id=cf86c9a3ba074b088afa318ea83b0d75&scope.project.id=c13570c1c1b34e468c99de23d788a795&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:00.573713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=77 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:00.726542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=41 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:46.943626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8fa1a-22d7-48c7-97df-1d7595113c45 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:46.944255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8fa1a-22d7-48c7-97df-1d7595113c45 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:46.944255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8fa1a-22d7-48c7-97df-1d7595113c45 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:46.946621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 591/1201] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:46.952467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:46.953057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:46.953057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:46.971404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:46.972680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:47.064275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 611/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:17:47.092793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8fa1a-22d7-48c7-97df-1d7595113c45 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:47.242525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8fa1a-22d7-48c7-97df-1d7595113c45 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:47.291713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931f68-9029-44da-a251-d55955871692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:47.292550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931f68-9029-44da-a251-d55955871692 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:47.292836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931f68-9029-44da-a251-d55955871692 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:47.293117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931f68-9029-44da-a251-d55955871692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:47.305066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9931f68-9029-44da-a251-d55955871692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:47.306718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9931f68-9029-44da-a251-d55955871692 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f9931f68-9029-44da-a251-d55955871692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:17:47.330455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:47.331545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:47.332563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:17:47.332563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:17:47.332563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:47.332563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:17:47.332563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 592/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:47.338902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:47.497890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c62dfe-d8bc-44f7-afd0-dc45404ddfd1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:47.534133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:47.541446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:47.542120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:47.542415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:47.542767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:47.543427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:47.543740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:47.545155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3fd7f-2ca1-4fe4-aad5-f8f0e17495c0 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:47.563909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 612/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:47.569040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931f68-9029-44da-a251-d55955871692 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:47.635580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:47.699125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931f68-9029-44da-a251-d55955871692 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:47.749295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb55410-b368-453b-8a8c-585921ed1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:47.749969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55410-b368-453b-8a8c-585921ed1a4c None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:47.750255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55410-b368-453b-8a8c-585921ed1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:47.750586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb55410-b368-453b-8a8c-585921ed1a4c None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:47.751343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb55410-b368-453b-8a8c-585921ed1a4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:47.752857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb55410-b368-453b-8a8c-585921ed1a4c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:47.775118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 593/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 16 00:17:47 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:17:50.286964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d60de1-7fbd-471a-bab9-2fc04e10ddc0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:50.287519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d60de1-7fbd-471a-bab9-2fc04e10ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:50.287519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d60de1-7fbd-471a-bab9-2fc04e10ddc0 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:50.289163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 613/1206] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:50.294604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:50.295074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:50.295188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:50.317743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:50.319038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:50.406982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 594/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:17:50.432377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d60de1-7fbd-471a-bab9-2fc04e10ddc0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:50.575671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d60de1-7fbd-471a-bab9-2fc04e10ddc0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:50.621711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:50.622675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:50.623035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:50.623328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:50.636595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:17:50.645316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:50.646548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:50.647415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 614/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:50.652655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:50.702975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:50.782220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4e97-0622-4a1b-977e-6f1d059fd6e1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:50.825451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:50.826193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:50.826508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:50.826706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:50.827513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:50.827830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:50.829236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:50.838860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 595/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:50.844743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:50.902071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:50.959054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35e25-2e18-4849-9fdc-721da1d44c66 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:50.997654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:50.998451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:50.998771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:50.999012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:51.010233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:51.011681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:17:51.030916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:51.032132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:51.037738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:17:51.037738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:17:51.037738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:51.037738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:51.037738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 615/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:17:51.039730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:51.166063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:51.170329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e5b1b-ea7a-45a0-95a7-ef2e66049637 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:51.208441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:51.209346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:51.209586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:51.209831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:51.210642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:51.211338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:51.212394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:51.227091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 596/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:51.232846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:51.345632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22613a2-604f-42e9-bf4b-08b4837db0d6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:51.347812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:51.390644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:51.391446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:51.391729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:51.392047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:51.400412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:51.401845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:17:51.417702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:51.418766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:51.419705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 616/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:17:51.425056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:51.545566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e57c78-aa46-4784-a59a-ffeacc1b94a6 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:51.588280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:51.589070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:51.589363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:51.589636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:51.590476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:51.590783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:51.593658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:51.613754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 597/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 00:17:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:51.620005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:51.738583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301698bc-9aad-4b4c-b592-08bfcfd3d308 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:51.793643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:51.794355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:51.794670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:51.795144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:51.838681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:51.882897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:51.884542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:51.999011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 617/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:17:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:17:52.005084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:52.027618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:52.128628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31af7d0-6242-4ece-ae06-960e2b8ec699 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:52.171088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:52.171982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:52.172275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:52.172579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:52.186631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:52.188316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:17:52.207839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:52.208869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:52.209802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:17:52.209802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:17:52.209802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:52.209802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:17:52.209802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 598/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:52.214794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:52.284401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:52.325860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9d3af-2dce-4719-81be-4755d421fbf1 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:52.360929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:52.361611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:52.361876 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:52.362166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:52.363011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:52.363363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:52.364875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:52.383318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 618/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:52.384434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:52.465423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:52.502482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35cf49-6af6-48fe-a9f8-88792bf8b24a None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:52.545399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:52.546651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:52.547153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:52.547463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:52.556284 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:52.558043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:17:52.573096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:52.574072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:17:52.575194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:17:52.579907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 599/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:17:52.580262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:52.690333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd222e1-8d43-4cff-b363-952e74d88f14 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:52.714708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:52.727569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:52.728268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:52.728551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:52.728830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:52.729615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:52.729921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:52.731599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3cdb8-caec-40da-aa2c-dc203ed12813 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:52.744401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 619/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:52.750457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:52.864423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b57909-eec5-4c26-af78-ccc1dcc6d154 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:52.897439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:52.905819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:52.906789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:52.907178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:52.907644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:52.908773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=832a04959b5448738fb9d46cf42845a2) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:52.909250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:52.910909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba5dd4-ecc2-4a80-b365-5caef395a680 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:52.924188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 600/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:17:52 2022] GET /identity/v3/role_assignments?user.id=832a04959b5448738fb9d46cf42845a2&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:55.212893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6772a16-4fc5-4ea5-bea2-2b887a4481f7 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:55.213440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6772a16-4fc5-4ea5-bea2-2b887a4481f7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:55.213440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6772a16-4fc5-4ea5-bea2-2b887a4481f7 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:55.214832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 620/1220] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:55.220507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:55.220949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:55.221109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:55.239493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:55.240755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:55.315432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 601/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:17:55.340091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6772a16-4fc5-4ea5-bea2-2b887a4481f7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:55.455653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6772a16-4fc5-4ea5-bea2-2b887a4481f7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:55.501280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:55.502395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:55.502860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:55.503274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:55.514673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:17:55.524132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:55.525362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:55.526463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 621/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:55.532971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:55.638620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c1fe-d8f3-48d6-ae26-32da164612ef None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:55.665638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:55.677643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:55.678319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:55.678607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:55.678889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:55.680622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] RBAC: Adding query filter params (name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:55.680934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:55.682708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:55.692503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 602/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:55.699292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:55.748047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:55.816686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13530-34db-4970-b58a-2d3d5744f2b8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:55.857554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:55.858666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:55.859073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:55.859363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:55.872669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:55.874476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:17:55.894393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:55.895470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:55.896734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:17:55.896734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:17:55.896734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:55.896734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:55.896734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 622/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:55.902351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:56.025102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f6e7c-69d2-4894-b0e1-01560ac92dab None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:56.065148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:56.065946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:56.066371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:56.066691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:56.067426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:56.067864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:56.069266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:56.086792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 603/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:17:56.092354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:56.195390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:56.203301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08654ce6-6106-42f0-8637-9d66d220a56a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:56.241221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:56.242431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:56.242735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:56.243037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:56.251348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:56.252976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:17:56.268443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:56.269983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:56.271372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 623/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:56.276494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:56.328696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:56.388802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b999c14-ba79-4bd2-9b6f-d583bcbf889f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:56.425067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:56.425741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:56.426036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:56.426315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:56.427153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:56.427465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:56.428917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:56.452875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 604/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 00:17:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:56.454125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:56.567952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440db09-073f-42bf-818a-286d2efca67d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:56.605226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:56.606311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:56.606600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:56.606879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:56.619389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:56.620915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:17:56.639037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:56.640163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:56.641190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:17:56.641190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:17:56.641190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:17:56.641190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:56.641190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 624/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:56.646428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:56.772139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9fa6-6bcc-4bfe-8089-97865a78af3c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:56.775111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:56.809000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:56.810198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:56.810766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:56.811275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:56.812261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:56.812580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:56.814651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:56.831792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 605/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:56.839138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:56.848879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:56.950057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275e48-8c1d-4e5e-a421-ce5b39f0ad77 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:56.986799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:56.987600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:56.987896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:56.988190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:56.995348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:56.996815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:17:57.011493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:57.012641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:17:57.013733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 625/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:17:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:57.018667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:57.137936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20b6c5-b3ce-4109-bedd-f4f5ce894a8d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:57.185176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:57.186048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:57.186374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:57.186780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:57.187856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:57.188202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:57.189674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77ee7-d3a3-47ff-9e0f-c97bcdca9e60 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:57.205094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 606/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:57.211211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:57.279797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:57.326507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ccf9-ae8c-4122-8e08-a3caec6665f8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:57.367415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219af2c0-6e58-4055-a1c3-65753d502e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:57.368338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af2c0-6e58-4055-a1c3-65753d502e0f None admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:57.368629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af2c0-6e58-4055-a1c3-65753d502e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:57.368911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af2c0-6e58-4055-a1c3-65753d502e0f None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/832a04959b5448738fb9d46cf42845a2/roles/761beeab640c4d539743da31146304a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:57.386052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219af2c0-6e58-4055-a1c3-65753d502e0f None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=832a04959b5448738fb9d46cf42845a2, role_id=761beeab640c4d539743da31146304a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:57.387620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219af2c0-6e58-4055-a1c3-65753d502e0f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:57.401921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 626/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:17:57 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/832a04959b5448738fb9d46cf42845a2/roles/761beeab640c4d539743da31146304a2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:17:59.679658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a0e0-ca50-4cb4-9e48-d3c88a796a61 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:59.680232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a0e0-ca50-4cb4-9e48-d3c88a796a61 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:59.680418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a0e0-ca50-4cb4-9e48-d3c88a796a61 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:59.681888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 607/1233] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:59.687687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:59.688135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:59.688359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:59.706778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:59.708144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:59.783866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 627/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:17:59.814349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a0e0-ca50-4cb4-9e48-d3c88a796a61 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:59.844192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:59.931319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a0e0-ca50-4cb4-9e48-d3c88a796a61 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:59.969181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:59.969978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:59.970262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:59.970539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:59.983948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:17:59.992866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:59.993865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:17:59.994955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 608/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 16 00:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:00.001201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:00.051293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:00.113776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0121ce-483f-48dd-b597-81e50e69bb34 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:00.152411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:00.153090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:00.153373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:00.153652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:00.154403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:00.154745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:00.156180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:00.170431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 628/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 16 00:18:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:00.171793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:00.265401 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:00.283493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917721e-38a2-41d6-bb8e-e5ec7219a595 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:00.321045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:00.321843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:00.322127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:00.322400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:00.334333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:00.336578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:00.355121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:00.356561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:00.357623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:00.357623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:00.357623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:00.357623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:00.357623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 609/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:00.362396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:00.467739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637eb74-a499-47dd-ac62-696ba3cd1eb4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:00.478592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:00.507664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:00.508414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:00.508696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:00.508965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:00.509739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:00.509991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:00.511358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:00.524510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 629/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:00.530348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:00.649889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3304a-d58a-44e0-9b78-71bae6881b9f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:00.688470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:00.689474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:00.689795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:00.690109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:00.693426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:00.700580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:00.702182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:18:00.718995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:00.720155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:00.721182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 610/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:00.726721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:00.857870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf84bc0-6504-4f0b-9426-0697d04da651 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:00.901406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:00.902095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:00.902380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:00.902742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:00.903635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:00.904087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:00.905524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:00.925700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 630/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 00:18:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:00.932755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:01.041796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0047b-5512-4065-9fcc-61277684c96d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:01.081613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:01.082302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:01.082587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:01.082861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:01.157105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:01.165073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:01.166559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:01.288117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 611/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:18:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:18:01.294681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:01.324926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:01.405919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352edfe-599a-4792-acf1-9538426d26fc None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:01.445482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:01.446315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:01.446645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:01.446944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:01.460044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:01.462553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:01.483047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:01.484056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:01.484950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:01.484950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:01.484950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:01.484950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:01.484950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 631/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:01.491127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:01.600663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:01.608161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e2b0c-0e8f-4395-931d-e37f406bcc95 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:01.649297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:01.649961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:01.650249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:01.650523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:01.651239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:01.651559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:01.653252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:01.668463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 612/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:01.677961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:01.776915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:01.805528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a605ec-f195-4f2c-b96b-296d3ef84c02 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:01.854410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:01.855262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:01.855956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:01.856219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:01.863634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:01.865218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:18:01.879676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:01.881829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:01.884470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 632/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:01.889291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:02.005656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc279-171a-4306-9147-714928dfe69d None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:02.043136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:02.043710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:02.044038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:02.044392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:02.045217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:02.045580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:02.046961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afdb3-6860-4ec0-97e7-ee8f51ef5e15 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:02.065374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 613/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:02.066802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:02.186676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518af97-7496-44d7-a828-18ef0f91499f None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:02.226778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:02.227442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:02.227731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:02.228046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:02.228882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] RBAC: Adding query filter params (role.id=761beeab640c4d539743da31146304a2, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=832a04959b5448738fb9d46cf42845a2) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:02.229206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:02.231163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77147e0-0c55-4dab-9f11-4a0fca72b34d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:02.238128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 633/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:18:02 2022] GET /identity/v3/role_assignments?user.id=832a04959b5448738fb9d46cf42845a2&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=761beeab640c4d539743da31146304a2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:04.572553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350b00-e7fd-4a32-9f20-93fdef5e5eef None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:04.573126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350b00-e7fd-4a32-9f20-93fdef5e5eef None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:04.573126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350b00-e7fd-4a32-9f20-93fdef5e5eef None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:04.575015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 614/1247] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:04.580882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:04.581334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:04.581437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:04.587921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:04.602804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:04.604126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:04.679840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 634/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:04.704735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7350b00-e7fd-4a32-9f20-93fdef5e5eef None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:04.724367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:04.831945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7350b00-e7fd-4a32-9f20-93fdef5e5eef None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:04.873761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:04.874725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:04.875024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:04.875305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:04.891653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:18:04.901123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:04.902149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:04.902998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 615/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:04.908747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:05.023679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5907-0a84-4724-981f-180f7bdd5e0f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:05.056666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:05.063641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:05.064451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:05.064772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:05.065099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:05.065850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:05.066170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:05.067650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:05.077874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 635/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:05.084095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:05.170812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:05.195079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ceab1-3998-4334-bf88-1d3402b8f5b5 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:05.231546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:05.232363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:05.232638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:05.232916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:05.245075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:05.246600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:05.263958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:05.265116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:05.266211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:05.266211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:05.266211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:05.266211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:05.266211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 616/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:05.271269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:05.382775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864a0bd-fc49-490c-91c4-afc17f9326b6 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:05.422270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:05.423041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:05.423395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:05.423701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:05.424674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:05.424992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:05.426598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:05.440158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 636/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:05.446252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:05.553449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dda20-fc06-4e4e-af62-938c0f80f57c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:05.580242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:05.589878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:05.590737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:05.591006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:05.591278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:05.599494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:05.601256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:18:05.616150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:05.617344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:05.618560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 617/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:05.623863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:05.687154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:05.739277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63f933-dfbb-4277-86ab-9d83d1a72b93 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:05.779514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:05.780222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:05.780630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:05.780920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:05.781967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:05.782352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:05.783842 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:05.811910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 637/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 00:18:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:05.815790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:05.941387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a85e-59d8-4349-8787-78e79c988df9 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:05.981080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:05.981736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:05.982022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:05.982303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.050030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:06.066722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:06.068371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:06.182726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 618/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:18:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:18:06.188778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:06.295514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966d538-48bc-4b69-8871-19a492d16cd8 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:06.310421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:06.332935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:06.333733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.334050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.334356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.344862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:06.346310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:06.365298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:06.366474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:06.372961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:06.372961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:06.372961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:06.372961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:06.372961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 638/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:06.373316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:06.467012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:06.480561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd1a10-d99c-42ad-9408-970d32ead904 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:06.517018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:06.517705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.517998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.518280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.519018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:06.519332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:06.520740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:06.536286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 619/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:06.542813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:06.643628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6d911-1c4d-45ac-872d-c96bc420d467 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:06.678203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:06.679924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.680186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.680459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.687271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:06.688745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:18:06.703287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:06.704398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:06.705716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 639/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:06.710334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:06.819852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910d47-57a7-4a2b-86e2-98268ed9441f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:06.857224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:06.857873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.858157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.858430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.859203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:06.859510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:06.860940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d339a-0f29-4f7b-87b9-d05a2afac70c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:06.873096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 620/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:06.879057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:06.907830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:06.981090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec425d-5a25-4d52-8a9c-cdd9d78d084c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:07.013219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:07.013875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:07.014162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:07.014441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:07.015266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=832a04959b5448738fb9d46cf42845a2) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:07.015581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:07.017043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1cb27-9881-4d46-9a96-41910e0a824b None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:07.022301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 640/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:18:06 2022] GET /identity/v3/role_assignments?user.id=832a04959b5448738fb9d46cf42845a2&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:09.116160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5afdbd-8650-4d0f-9843-8826d076c2c8 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.117361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5afdbd-8650-4d0f-9843-8826d076c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.117361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5afdbd-8650-4d0f-9843-8826d076c2c8 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.118698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 621/1261] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:09.123930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.124326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.124504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.140919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:09.142102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:09.206915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 641/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:09.229898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5afdbd-8650-4d0f-9843-8826d076c2c8 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:09.240845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:09.329073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5afdbd-8650-4d0f-9843-8826d076c2c8 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:09.361950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:09.362740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.363030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.363310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.373953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:18:09.382265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:09.383383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:09.384456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 622/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:09.389505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:09.407779 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:09.486367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985e933-a78e-4103-aa89-41e02c5dfedd None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:09.518387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:09.519036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.519323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.519602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.520365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:09.520817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:09.522182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:09.530742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 642/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:09.536594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:09.602767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:09.635308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffda74-e147-4c28-92c5-ecb07726fb1b None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:09.668401 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:09.669183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.669476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.669757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.680253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:09.681694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:09.698296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:09.699354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:09.700385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:09.700385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:09.700385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:09.700385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:09.700385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 623/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:09.705367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:09.784039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:09.808407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09a67d-018c-44b1-93d9-7e49e6bafe37 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:09.849782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:09.850448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.850743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.851240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.852205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:09.852572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:09.854073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:09.867806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 643/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:09.873746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:09.973998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051b486-f49c-4f8d-8ea7-7efce0e96443 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:09.997082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:10.011560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.012393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.012678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.012955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.020382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.021809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:18:10.036440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:10.038095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:10.039349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 624/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:10.043949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.140854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab504c2-a934-464e-9bfa-f89fdbb211c4 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.174326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.174985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.175274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.175552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.176409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:10.176720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.178139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.186932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:10.196386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 644/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 00:18:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:10.202021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.299103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3650-9701-4c0c-89c8-97edf4f4eb5f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.331958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.332732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.333021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.333303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.344833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.346262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:10.363505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:10.364598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:10.365879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:10.365879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:10.365879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:10.365879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:10.365879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 625/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:10.370240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.465736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682bebb-765c-49ae-8bbd-3db6ca4e9c1d None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.498189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.498833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.499116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.499392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.500170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:10.500475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.501831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.513233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 645/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:10.518812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.550319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:10.618102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8c528-ed4f-4079-8ab4-571661f5b46c None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.649920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.650709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.650999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.651280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.657828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.659264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:18:10.673754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:10.674814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:10.676092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 626/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:10.681378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.738036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:10.779330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cdf88-7772-4962-911c-56d8c44b6855 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.815812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.816486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.816764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.817041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.817825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:10.818134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.820102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac5aa-cab2-4258-82d1-1a9ad4c54744 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.833104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 646/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:10.840149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.933163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:10.942143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4813e-d68f-4d1a-8c67-eadeaf7a4519 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.975635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e34ea-d73b-4fef-ba26-1f2a0dac06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.977085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e34ea-d73b-4fef-ba26-1f2a0dac06a6 None admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.977373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e34ea-d73b-4fef-ba26-1f2a0dac06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.977653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e34ea-d73b-4fef-ba26-1f2a0dac06a6 None admin] PATH_INFO: `/v3/projects/c36fde2902e4433f992944525dfd2b56/users/832a04959b5448738fb9d46cf42845a2/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.979598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e34ea-d73b-4fef-ba26-1f2a0dac06a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c36fde2902e4433f992944525dfd2b56, user_id=832a04959b5448738fb9d46cf42845a2, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.981309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e34ea-d73b-4fef-ba26-1f2a0dac06a6 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.994609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 627/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 16 00:18:10 2022] PUT /identity/v3/projects/c36fde2902e4433f992944525dfd2b56/users/832a04959b5448738fb9d46cf42845a2/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:18:13.106064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e703-5755-4cbc-aea2-419f82738879 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.106643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e703-5755-4cbc-aea2-419f82738879 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.106643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10e703-5755-4cbc-aea2-419f82738879 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.108006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 647/1274] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:13.112969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.113356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.113528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.129877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:13.131043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:13.198053 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 628/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:13.220855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e703-5755-4cbc-aea2-419f82738879 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:13.319044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10e703-5755-4cbc-aea2-419f82738879 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:13.336370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:13.352444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:13.353226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.353516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.353800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.363927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:18:13.372085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:13.373236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:13.374318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 648/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 16 00:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:13.379286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:13.459507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:13.478998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9495d4a-0c95-4dcb-97f7-a0e75cf49d17 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:13.517002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:13.517678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.517970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.518256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.519007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:13.519321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:13.520716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:13.529336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 629/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 16 00:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:13.534979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:13.633021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d3ac0-b162-4fdb-8036-a85ce7dbb38a None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:13.665290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369f6b-1195-4121-a989-27605438367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:13.666071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369f6b-1195-4121-a989-27605438367c None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.666358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369f6b-1195-4121-a989-27605438367c None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.666639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369f6b-1195-4121-a989-27605438367c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.676748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369f6b-1195-4121-a989-27605438367c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:13.678181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369f6b-1195-4121-a989-27605438367c None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-12369f6b-1195-4121-a989-27605438367c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:13.695345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:13.696437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:13.697664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:13.697664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:13.697664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:13.697664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:13.697664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 649/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:13.702376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:13.803793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ebf5-0d80-40f8-8eab-cce3aacc082e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:13.842331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:13.843032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.843369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.843649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.844471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:13.844777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:13.846412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:13.860026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 630/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:13.866322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369f6b-1195-4121-a989-27605438367c None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:13.899463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:13.966928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369f6b-1195-4121-a989-27605438367c None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:13.999575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.000397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.000688 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.000968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.009078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.010510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:18:14.024695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:14.025798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:14.026804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 650/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:14.031714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.035549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:14.129680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313caa5f-dc13-4072-96e5-2b087e823b35 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.162243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.162841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.163126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.163843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.164442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:14.164751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.166161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.183192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 631/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:14.188909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.277557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:14.287039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebff04-4fd3-4f81-bc33-f7cb6c380738 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.320281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.320916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.321202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.321480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.385497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.386924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.470169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:14.481290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 651/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:18:14.487004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.546812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:14.583944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df9eb-c09b-4486-ae76-e81d4b963174 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.617866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.618648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.618933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.619209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.628912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.630327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:18:14.647122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:14.648715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:14.649835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:18:14.649835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:18:14.649835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:18:14.649835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:14.649835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 632/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:14.654487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.750153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495a97-f089-4a8a-b76c-20e1e788efd3 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.782801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.783450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.783752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.784048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.784760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:14.785069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.786427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.799637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 652/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:14.805815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.902832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c865a5b-109b-4899-bdb2-5ca90954e96f None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.916354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:14.937364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.938151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.938436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.938712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.946150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.947770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:18:14.961561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:14.962454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: ERROR keystone.server.flask.application Jun 16 00:18:14.963483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 633/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:14.968520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:15.017895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:15.067235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249ebaf-3e2f-4976-a1cc-584fedd28132 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:15.099214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:15.099914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:15.100206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:15.100487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:15.101892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:15.102202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:15.103632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba41435-fa7c-467b-8f3e-f0c4ed899f00 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:15.116111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 653/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:15.122757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:15.218841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9732d-ffee-4e1e-b78c-0a303b182e95 None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:15.252428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:15.253077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:15.253367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:15.253650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:15.254482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] RBAC: Adding query filter params (role.id=e4303aac64d845f886dcf1e0f14c4fc6, scope.project.id=c36fde2902e4433f992944525dfd2b56, user.id=832a04959b5448738fb9d46cf42845a2) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:15.254797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:15.256241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20939f1f-de97-4f24-9892-4d4544269a00 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:15.262375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 634/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 16 00:18:15 2022] GET /identity/v3/role_assignments?user.id=832a04959b5448738fb9d46cf42845a2&scope.project.id=c36fde2902e4433f992944525dfd2b56&role.id=e4303aac64d845f886dcf1e0f14c4fc6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:17.380340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8ae5-04db-4538-9dac-ad5204da0a43 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.380836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8ae5-04db-4538-9dac-ad5204da0a43 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.380836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd8ae5-04db-4538-9dac-ad5204da0a43 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.382750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 654/1288] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:17.387821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.388267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.388405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.404977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:17.406145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:17.435597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:17.472993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 635/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:17.496729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8ae5-04db-4538-9dac-ad5204da0a43 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:17.594359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd8ae5-04db-4538-9dac-ad5204da0a43 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:17.605401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:17.631471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:17.632823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.633353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.633884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.634627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:17.636038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:17.648232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:17.649547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:17.650608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 655/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:18:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:17.655452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:17.750956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9c13a-6ed5-41aa-b43e-3164308cfb45 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:17.784807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:17.785469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.785755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.786036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.786741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:17.787051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:17.789424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c4a7-761c-45f4-b417-7a4915356332 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:17.794414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 636/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 00:18:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:17.800385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:17.912111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ae26c-4411-4b03-8934-07d993189942 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:17.949403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:17.950257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.950677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.950995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] PATH_INFO: `/v3/services` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.951697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:17.952036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:17.953410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb1702-0aa1-4df9-b6a0-0f74f883c2e4 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:17.957777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 656/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 00:18:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:20.061639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fbd9-23d1-4ecf-9630-caa22aefb71d None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.062072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fbd9-23d1-4ecf-9630-caa22aefb71d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.062208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fbd9-23d1-4ecf-9630-caa22aefb71d None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.063598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 637/1293] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:20.068690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9b4f-55de-46a5-9310-876130436f02 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.069112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9b4f-55de-46a5-9310-876130436f02 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.069257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9b4f-55de-46a5-9310-876130436f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.086277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-61db9b4f-55de-46a5-9310-876130436f02 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:20.087450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-61db9b4f-55de-46a5-9310-876130436f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:20.115916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:20.153354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 657/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:20.175212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fbd9-23d1-4ecf-9630-caa22aefb71d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:20.205834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:20.274521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fbd9-23d1-4ecf-9630-caa22aefb71d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:20.306506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97331f5-af3b-46d0-a40d-cae424fc901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:20.307096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97331f5-af3b-46d0-a40d-cae424fc901a None admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.307380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97331f5-af3b-46d0-a40d-cae424fc901a None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.307655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97331f5-af3b-46d0-a40d-cae424fc901a None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.308387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97331f5-af3b-46d0-a40d-cae424fc901a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:20.309731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97331f5-af3b-46d0-a40d-cae424fc901a None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:20.322667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 638/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 16 00:18:20 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:18:22.457253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935646-cd1e-4742-a2c2-4895a1a76824 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.457766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935646-cd1e-4742-a2c2-4895a1a76824 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.457766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f935646-cd1e-4742-a2c2-4895a1a76824 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.459108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 658/1296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:22.464856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.465281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.465420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.482783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:22.484007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:22.557410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 639/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:22.580669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f935646-cd1e-4742-a2c2-4895a1a76824 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:22.685407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f935646-cd1e-4742-a2c2-4895a1a76824 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:22.719467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:22.720227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.720513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.720790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.721435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:22.722806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:22.735381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:22.736564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:22.737487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 659/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:18:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:22.742710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:22.761344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:22.845877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d7061-637f-411f-a890-666580213ac9 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:22.878016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:22.878673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.878956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.879233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.879962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:22.880273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:22.881619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:22.887173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 640/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 00:18:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:22.893055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:22.924207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:22.995786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0201b85-bb37-4891-9f12-1889f356c061 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:23.028611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:23.029263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:23.029550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:23.029830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:23.030617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] RBAC: Adding query filter params (interface=public, service_id=6685a492b6fe41e2b2516e3475935653, region_id=RegionOne) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:23.030932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:23.032339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb006f2b-9e13-4006-9530-5bd4b1540979 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:23.037278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 660/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 16 00:18:22 2022] GET /identity/v3/endpoints?service_id=6685a492b6fe41e2b2516e3475935653&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:23.043038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:23.122787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:23.140933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97867d4-c994-433c-ab68-039e6dda308e None admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:23.172982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a644db-a2dd-41f5-81ab-6d6a170dbf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:23.173636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a644db-a2dd-41f5-81ab-6d6a170dbf39 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:23.173923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a644db-a2dd-41f5-81ab-6d6a170dbf39 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:23.174202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a644db-a2dd-41f5-81ab-6d6a170dbf39 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:23.174876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a644db-a2dd-41f5-81ab-6d6a170dbf39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:23.176264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a644db-a2dd-41f5-81ab-6d6a170dbf39 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:23.183400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 641/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 16 00:18:23 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:18:25.297548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086a3b-e368-48d0-822e-755a404707b5 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.298145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086a3b-e368-48d0-822e-755a404707b5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.298145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086a3b-e368-48d0-822e-755a404707b5 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.299469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 661/1302] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:25.305444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655d37c-4508-479a-9943-341da4632172 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.305853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655d37c-4508-479a-9943-341da4632172 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.305958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655d37c-4508-479a-9943-341da4632172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.322870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8655d37c-4508-479a-9943-341da4632172 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:25.324088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8655d37c-4508-479a-9943-341da4632172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:25.390033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 642/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:18:25.412606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086a3b-e368-48d0-822e-755a404707b5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:25.506722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:25.514571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086a3b-e368-48d0-822e-755a404707b5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:25.546971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:25.547754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.548080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.548363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.549020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:25.550383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:18:25.562569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:18:25.563709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application with Lock( Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: ERROR keystone.server.flask.application Jun 16 00:18:25.564963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 662/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 16 00:18:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:18:25.569615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655d37c-4508-479a-9943-341da4632172 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:25.644421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:25.667700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655d37c-4508-479a-9943-341da4632172 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:25.700650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:25.701311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.701600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.701879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] PATH_INFO: `/v3/services` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.702581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:18:25.702889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:25.704289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a443-32ca-45ec-9e4d-e907842d5dc2 None admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:25.709326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 643/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 16 00:18:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:18:25.715385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:25.815098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00e79-1b21-411f-b126-5de4f4574b65 None admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:25.847826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c6783-f63b-4e14-9a44-49d4949cd53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:25.848501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6783-f63b-4e14-9a44-49d4949cd53f None admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.848790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6783-f63b-4e14-9a44-49d4949cd53f None admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.849068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6783-f63b-4e14-9a44-49d4949cd53f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.849797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c6783-f63b-4e14-9a44-49d4949cd53f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:25.852220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c6783-f63b-4e14-9a44-49d4949cd53f None admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:25.870778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 663/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 16 00:18:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:18:35.706309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=30 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:35.865650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:28.781842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d651e7-8c91-41a8-b1cf-a72214208573 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.782408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d651e7-8c91-41a8-b1cf-a72214208573 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.782408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d651e7-8c91-41a8-b1cf-a72214208573 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.790071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e9a4-10e0-4a24-bec1-8b91ac79c967 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.790623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e9a4-10e0-4a24-bec1-8b91ac79c967 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.790623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e9a4-10e0-4a24-bec1-8b91ac79c967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.794166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 644/1307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:28.893249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f804e9a4-10e0-4a24-bec1-8b91ac79c967 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:28.894534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f804e9a4-10e0-4a24-bec1-8b91ac79c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:29.003272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 664/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:29.072435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64ad56-b4f7-4101-942f-40d4ae2503d6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.072758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64ad56-b4f7-4101-942f-40d4ae2503d6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.073013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64ad56-b4f7-4101-942f-40d4ae2503d6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.075527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 645/1309] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 16 00:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:29.089275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eacc48-21fd-4627-9829-0545238b5f14 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.089595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eacc48-21fd-4627-9829-0545238b5f14 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.089940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eacc48-21fd-4627-9829-0545238b5f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.250819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d8eacc48-21fd-4627-9829-0545238b5f14 None None] MFA Rules not processed for user `cb15a3e003fb4f0f8f876c5635b6a020`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:29.254494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d8eacc48-21fd-4627-9829-0545238b5f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:29.314134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.447416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 665/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 16 00:19:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:29.456610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64ad56-b4f7-4101-942f-40d4ae2503d6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.458383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-cc64ad56-b4f7-4101-942f-40d4ae2503d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:29.637188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64ad56-b4f7-4101-942f-40d4ae2503d6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.731508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.732205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.732492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.732766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.734435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:29.795636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.857655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.859096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbfc4f-c63b-4d28-8d59-883d0c48efd5 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.880030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 646/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:32.368593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273a40-db0d-41c5-a266-c0f8b4d8bd01 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.369094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273a40-db0d-41c5-a266-c0f8b4d8bd01 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.369094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273a40-db0d-41c5-a266-c0f8b4d8bd01 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.370469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 666/1312] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:32.375621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf117-5a82-4535-8c0a-1b7caf92ec38 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.376066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf117-5a82-4535-8c0a-1b7caf92ec38 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.376373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf117-5a82-4535-8c0a-1b7caf92ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.459416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3b2bf117-5a82-4535-8c0a-1b7caf92ec38 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:32.460694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3b2bf117-5a82-4535-8c0a-1b7caf92ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:32.557749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 647/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:32.595759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273a40-db0d-41c5-a266-c0f8b4d8bd01 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:32.597693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-25273a40-db0d-41c5-a266-c0f8b4d8bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:32.714363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273a40-db0d-41c5-a266-c0f8b4d8bd01 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:32.795854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:32.796701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:32.797083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:32.797462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:32.799324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:32.811748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:32.915940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:32.917393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c5666-5cdc-4bac-89d3-f0528ec05887 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:32.939950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 667/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:35.357529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce62107-af6b-4d84-9a28-ba135b1503e1 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.358031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce62107-af6b-4d84-9a28-ba135b1503e1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.358031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce62107-af6b-4d84-9a28-ba135b1503e1 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.359578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 648/1315] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:35.364448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40efd01-b880-44f3-9f4a-984f9b11f2c4 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.364868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40efd01-b880-44f3-9f4a-984f9b11f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.365845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40efd01-b880-44f3-9f4a-984f9b11f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.432126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f40efd01-b880-44f3-9f4a-984f9b11f2c4 None None] MFA Rules not processed for user `23a8bb99dc8d4e7092a8bf1a6d09759c`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:35.433314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f40efd01-b880-44f3-9f4a-984f9b11f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:35.484578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.528944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 668/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:35.569960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce62107-af6b-4d84-9a28-ba135b1503e1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:35.571493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1ce62107-af6b-4d84-9a28-ba135b1503e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:35.581215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.677269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce62107-af6b-4d84-9a28-ba135b1503e1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:35.756276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:35.756929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:35.757217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:35.757500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:35.759144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:35.822271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:35.869444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:35.870886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407d112-f41b-415b-885d-6a149d93c078 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:35.889058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 649/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:38.522834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637fd0-56b3-4767-b039-553bb9d4e5c8 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.523360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637fd0-56b3-4767-b039-553bb9d4e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.523490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637fd0-56b3-4767-b039-553bb9d4e5c8 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.524820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 669/1318] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:38.529953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e9e1a-62b2-43dc-a67e-9aad75ea9337 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.530383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e9e1a-62b2-43dc-a67e-9aad75ea9337 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.530510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e9e1a-62b2-43dc-a67e-9aad75ea9337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.593832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9f4e9e1a-62b2-43dc-a67e-9aad75ea9337 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:38.595096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9f4e9e1a-62b2-43dc-a67e-9aad75ea9337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:38.692072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 650/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:38.745854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75ce2-7136-4d51-b4f0-14c58a22c4a0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.746143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75ce2-7136-4d51-b4f0-14c58a22c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.746420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75ce2-7136-4d51-b4f0-14c58a22c4a0 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.747794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 670/1320] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 16 00:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:38.754212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d474-31c0-459d-80b9-9f848340660c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:38.754689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d474-31c0-459d-80b9-9f848340660c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:38.755147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d474-31c0-459d-80b9-9f848340660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:38.775907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:38.836007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1e12d474-31c0-459d-80b9-9f848340660c None None] MFA Rules not processed for user `cb15a3e003fb4f0f8f876c5635b6a020`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:38.837200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1e12d474-31c0-459d-80b9-9f848340660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:38.912848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 651/1321] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 16 00:19:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:38.921788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75ce2-7136-4d51-b4f0-14c58a22c4a0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:38.923309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-94c75ce2-7136-4d51-b4f0-14c58a22c4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:39.025218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75ce2-7136-4d51-b4f0-14c58a22c4a0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:39.098403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:39.099045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:39.099354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:39.099983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:39.101450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:39.108424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:39.209852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:39.211303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb955719-24ca-4bda-a298-cc08b487f5cd service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:39.228746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 671/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:42.466645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d1b92-b462-4b17-a929-0413414f8b33 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.467194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d1b92-b462-4b17-a929-0413414f8b33 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.467194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d1b92-b462-4b17-a929-0413414f8b33 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.468623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 652/1323] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:42.473879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e06b3-fe8a-435d-b56b-d688637d51e1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.474932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e06b3-fe8a-435d-b56b-d688637d51e1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.475215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e06b3-fe8a-435d-b56b-d688637d51e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.545263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-901e06b3-fe8a-435d-b56b-d688637d51e1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:42.546494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-901e06b3-fe8a-435d-b56b-d688637d51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:42.609507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.652659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 672/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:42.690137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d1b92-b462-4b17-a929-0413414f8b33 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:42.691652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-338d1b92-b462-4b17-a929-0413414f8b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:42.805156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d1b92-b462-4b17-a929-0413414f8b33 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:42.817295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:42.879554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:42.880230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:42.881051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:42.881328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:42.882970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:42.994566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:42.996065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56af4-1f76-4158-a2a0-266c338d42e9 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:43.014722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 653/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:45.231915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f62268-cf13-45c2-b3db-9454043aa61e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.232733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f62268-cf13-45c2-b3db-9454043aa61e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.232733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f62268-cf13-45c2-b3db-9454043aa61e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.234324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 673/1326] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:45.239338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a474eb-c709-4114-b569-bdd05415ed94 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.239798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a474eb-c709-4114-b569-bdd05415ed94 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.240036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a474eb-c709-4114-b569-bdd05415ed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.290986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.311768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e3a474eb-c709-4114-b569-bdd05415ed94 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:45.313362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e3a474eb-c709-4114-b569-bdd05415ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:45.417587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 654/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:45.454099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f62268-cf13-45c2-b3db-9454043aa61e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:45.455632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-06f62268-cf13-45c2-b3db-9454043aa61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:45.564792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f62268-cf13-45c2-b3db-9454043aa61e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:45.641299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:45.641949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:45.642244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:45.642521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:45.644194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:45.661363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:45.763086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:45.764566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1453a-2f06-468c-b441-4b1a0a88905a service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:45.782065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 674/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:47.992267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5feb3-9479-48e0-8df1-375dbb531d93 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.992799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5feb3-9479-48e0-8df1-375dbb531d93 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:47.992912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5feb3-9479-48e0-8df1-375dbb531d93 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:47.994201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 655/1329] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:47.999434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdc311-2c3e-4934-a110-6ce89217fe2f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:47.999833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdc311-2c3e-4934-a110-6ce89217fe2f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:48.000158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdc311-2c3e-4934-a110-6ce89217fe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:48.075178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-34bdc311-2c3e-4934-a110-6ce89217fe2f None None] MFA Rules not processed for user `23a8bb99dc8d4e7092a8bf1a6d09759c`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:48.076405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-34bdc311-2c3e-4934-a110-6ce89217fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:48.144043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:48.176613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 675/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:48.214295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5feb3-9479-48e0-8df1-375dbb531d93 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:48.215832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f8b5feb3-9479-48e0-8df1-375dbb531d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:48.341903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5feb3-9479-48e0-8df1-375dbb531d93 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:48.364280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:48.423059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:48.423721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:48.424042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:48.424328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:48.425989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:48.534961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:48.536395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086603c-46ec-4667-9583-3eedf645801e service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:48.556312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 656/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:50.934377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a9c55-f79c-47d6-b011-1a5460677aac None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.934957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a9c55-f79c-47d6-b011-1a5460677aac None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.934957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a9c55-f79c-47d6-b011-1a5460677aac None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:50.937559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 676/1332] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:50.944800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28adea-e458-4da5-b9c7-54e4ce30faff None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:50.945238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28adea-e458-4da5-b9c7-54e4ce30faff None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:50.945407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28adea-e458-4da5-b9c7-54e4ce30faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.022961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.028312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1e28adea-e458-4da5-b9c7-54e4ce30faff None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:51.029798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1e28adea-e458-4da5-b9c7-54e4ce30faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:51.166503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 657/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:51.211000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a9c55-f79c-47d6-b011-1a5460677aac None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:51.212626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a03a9c55-f79c-47d6-b011-1a5460677aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:51.324934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a9c55-f79c-47d6-b011-1a5460677aac None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:51.403421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:51.404100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:51.404387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:51.404747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:51.406412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:51.434352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:51.524287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:51.525778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7e715-be7d-47f9-b640-30430af71235 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:51.545226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 677/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:53.686586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565aa70e-9f9d-4765-824c-71b1044374d8 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.687125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565aa70e-9f9d-4765-824c-71b1044374d8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.687248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565aa70e-9f9d-4765-824c-71b1044374d8 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.688566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 658/1335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:53.695617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a68b3-6ff9-4a72-b924-9b86d287a918 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:53.696051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a68b3-6ff9-4a72-b924-9b86d287a918 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:53.696225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a68b3-6ff9-4a72-b924-9b86d287a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:53.762181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6e0a68b3-6ff9-4a72-b924-9b86d287a918 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:53.763439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6e0a68b3-6ff9-4a72-b924-9b86d287a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:53.837295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:53.860115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 678/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:53.899851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565aa70e-9f9d-4765-824c-71b1044374d8 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:53.901396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-565aa70e-9f9d-4765-824c-71b1044374d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:54.005739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565aa70e-9f9d-4765-824c-71b1044374d8 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:54.034045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:54.080098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:54.080749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:54.081036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:54.081320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:54.082953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:54.190802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:54.192276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52247b4d-b124-45a8-9263-d807dee35534 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:54.211452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 659/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:56.711994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e1348-9491-4dd5-b024-6bc3ae268cec None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.712530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e1348-9491-4dd5-b024-6bc3ae268cec None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.712626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e1348-9491-4dd5-b024-6bc3ae268cec None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.713955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 679/1338] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:56.719219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb87a4-9ad0-4ace-85c3-9c2adda2444c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.719600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb87a4-9ad0-4ace-85c3-9c2adda2444c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.719789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb87a4-9ad0-4ace-85c3-9c2adda2444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.784329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7efb87a4-9ad0-4ace-85c3-9c2adda2444c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:56.785548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7efb87a4-9ad0-4ace-85c3-9c2adda2444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:56.793934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.889862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 660/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:56.924936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e1348-9491-4dd5-b024-6bc3ae268cec None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:56.926484 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-177e1348-9491-4dd5-b024-6bc3ae268cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:57.033531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e1348-9491-4dd5-b024-6bc3ae268cec None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.107029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.107955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.108246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.108528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.110169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:57.144935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:57.217520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.218964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc109-b42d-47c2-9a0d-2568618bef95 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.237495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 680/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:01.297091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ffff0-1358-4c34-93bf-5c68c681cc13 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.297604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ffff0-1358-4c34-93bf-5c68c681cc13 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.297604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ffff0-1358-4c34-93bf-5c68c681cc13 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.298939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 661/1341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:01.304246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f27a4-4869-40b0-bb00-4b94461d49e9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.304669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f27a4-4869-40b0-bb00-4b94461d49e9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.304925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f27a4-4869-40b0-bb00-4b94461d49e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.377050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-924f27a4-4869-40b0-bb00-4b94461d49e9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:01.378437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-924f27a4-4869-40b0-bb00-4b94461d49e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:01.476180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:01.491323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 681/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:01.531378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ffff0-1358-4c34-93bf-5c68c681cc13 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:01.533554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ce1ffff0-1358-4c34-93bf-5c68c681cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:01.631635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ffff0-1358-4c34-93bf-5c68c681cc13 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:01.635325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfd020-a81c-4e5d-86a8-fd51b2523243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:01.636449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd020-a81c-4e5d-86a8-fd51b2523243 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.636942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd020-a81c-4e5d-86a8-fd51b2523243 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.637450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd020-a81c-4e5d-86a8-fd51b2523243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.650101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd020-a81c-4e5d-86a8-fd51b2523243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:01.651613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd020-a81c-4e5d-86a8-fd51b2523243 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:01.662279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 662/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:04.392862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb908dc-2a2a-4fbe-bf53-efa9d7c80d1e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.393404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb908dc-2a2a-4fbe-bf53-efa9d7c80d1e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.393404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb908dc-2a2a-4fbe-bf53-efa9d7c80d1e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.394966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 682/1344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:04.401832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b8255-0664-465b-aa3d-8288d9b4e7be None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.402382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b8255-0664-465b-aa3d-8288d9b4e7be None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.402382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b8255-0664-465b-aa3d-8288d9b4e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.433954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-147b8255-0664-465b-aa3d-8288d9b4e7be None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:04.435189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-147b8255-0664-465b-aa3d-8288d9b4e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:04.467116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:04.521901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 663/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:04.559961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb908dc-2a2a-4fbe-bf53-efa9d7c80d1e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.570994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb908dc-2a2a-4fbe-bf53-efa9d7c80d1e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.574661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ece283-acf1-47df-8037-2d0aa50f9e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.575330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ece283-acf1-47df-8037-2d0aa50f9e5c service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.575617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ece283-acf1-47df-8037-2d0aa50f9e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.575929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ece283-acf1-47df-8037-2d0aa50f9e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.585919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ece283-acf1-47df-8037-2d0aa50f9e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.587509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ece283-acf1-47df-8037-2d0aa50f9e5c service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.597329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 683/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:08.763254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b2c60-2396-4ccc-80cd-afe116ce8556 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.763791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b2c60-2396-4ccc-80cd-afe116ce8556 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.763910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b2c60-2396-4ccc-80cd-afe116ce8556 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.765252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 664/1347] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:08.770513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638853-26cb-45ed-bfa2-8fbd0b846c95 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.771651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638853-26cb-45ed-bfa2-8fbd0b846c95 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.771651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12638853-26cb-45ed-bfa2-8fbd0b846c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.789438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-12638853-26cb-45ed-bfa2-8fbd0b846c95 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:08.790667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-12638853-26cb-45ed-bfa2-8fbd0b846c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:08.798722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 684/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:08.837850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b2c60-2396-4ccc-80cd-afe116ce8556 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.848441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b2c60-2396-4ccc-80cd-afe116ce8556 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.852752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215d49-b5fd-4a9a-9450-98e07c2b9036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.853392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215d49-b5fd-4a9a-9450-98e07c2b9036 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.853675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215d49-b5fd-4a9a-9450-98e07c2b9036 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.853954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215d49-b5fd-4a9a-9450-98e07c2b9036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.863166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215d49-b5fd-4a9a-9450-98e07c2b9036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:08.864678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215d49-b5fd-4a9a-9450-98e07c2b9036 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:08.874399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 665/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:13.841559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf142b-643c-41d7-b00b-b6f9c1c587e1 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.842078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf142b-643c-41d7-b00b-b6f9c1c587e1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.842161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf142b-643c-41d7-b00b-b6f9c1c587e1 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.843504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 685/1350] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:13.857986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce666bc-ba27-4a61-9055-396f3e9a53d2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.859051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce666bc-ba27-4a61-9055-396f3e9a53d2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.859540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce666bc-ba27-4a61-9055-396f3e9a53d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.940416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9ce666bc-ba27-4a61-9055-396f3e9a53d2 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:13.942275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9ce666bc-ba27-4a61-9055-396f3e9a53d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:14.023389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 666/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:18.394997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d49b1-a5a4-4d46-bbd9-d706db278566 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:18.395620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d49b1-a5a4-4d46-bbd9-d706db278566 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:18.395966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d49b1-a5a4-4d46-bbd9-d706db278566 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:18.398028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 686/1352] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:18.403110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330d11-f1df-4eff-8eb9-98c58c1f5342 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:18.403628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330d11-f1df-4eff-8eb9-98c58c1f5342 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:18.406555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330d11-f1df-4eff-8eb9-98c58c1f5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:18.426240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8b330d11-f1df-4eff-8eb9-98c58c1f5342 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:18.428231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8b330d11-f1df-4eff-8eb9-98c58c1f5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:18.436986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 667/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:20:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:18.783790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=13 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:19.882243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8d53-8780-4b11-b93b-5325c98225a0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.882820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8d53-8780-4b11-b93b-5325c98225a0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.882820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8d53-8780-4b11-b93b-5325c98225a0 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.884224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 687/1354] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:19.889183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae343-1c19-464b-aa87-1a7b5f5c4fb9 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:19.889616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae343-1c19-464b-aa87-1a7b5f5c4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:19.889730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae343-1c19-464b-aa87-1a7b5f5c4fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:19.908110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-047ae343-1c19-464b-aa87-1a7b5f5c4fb9 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:19.909321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-047ae343-1c19-464b-aa87-1a7b5f5c4fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:19.918362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 668/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:20:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:23.659193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a724-7a54-4b4a-b48d-216b6e80c37c None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.659684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a724-7a54-4b4a-b48d-216b6e80c37c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.659684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0a724-7a54-4b4a-b48d-216b6e80c37c None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.661137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 688/1356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:23.666669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eab3e-bef5-447d-a558-791632c954f3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.667155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eab3e-bef5-447d-a558-791632c954f3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.667540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eab3e-bef5-447d-a558-791632c954f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.686678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d85eab3e-bef5-447d-a558-791632c954f3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:23.687804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d85eab3e-bef5-447d-a558-791632c954f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:23.696868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 669/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:23.751462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c2636-5688-4a72-953a-5c83c42aed9e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.752490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c2636-5688-4a72-953a-5c83c42aed9e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.753078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c2636-5688-4a72-953a-5c83c42aed9e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.755128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 689/1358] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 00:20:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:23.762047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32998a0-c0ac-4e0a-a8d4-226d22b4a2ca None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.762344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32998a0-c0ac-4e0a-a8d4-226d22b4a2ca None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.762820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32998a0-c0ac-4e0a-a8d4-226d22b4a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.813649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:23.823677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a32998a0-c0ac-4e0a-a8d4-226d22b4a2ca None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:23.825172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a32998a0-c0ac-4e0a-a8d4-226d22b4a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:23.917663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 670/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 00:20:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:23.925642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c2636-5688-4a72-953a-5c83c42aed9e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:23.940806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c2636-5688-4a72-953a-5c83c42aed9e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:23.947340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91e50-7e02-42b7-9fc8-1c157224bcd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:23.948324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91e50-7e02-42b7-9fc8-1c157224bcd9 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:23.948791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91e50-7e02-42b7-9fc8-1c157224bcd9 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:23.949224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91e50-7e02-42b7-9fc8-1c157224bcd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:23.959347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91e50-7e02-42b7-9fc8-1c157224bcd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:23.961279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91e50-7e02-42b7-9fc8-1c157224bcd9 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:23.972013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 690/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:26.326270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a5be-6b62-4f1d-a7de-fb5ca22ec2e0 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.326801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a5be-6b62-4f1d-a7de-fb5ca22ec2e0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.326801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a5be-6b62-4f1d-a7de-fb5ca22ec2e0 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.328532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 671/1361] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:26.334773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99502581-4e67-4180-af03-cf92f019fc91 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.335606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99502581-4e67-4180-af03-cf92f019fc91 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.336077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99502581-4e67-4180-af03-cf92f019fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.356453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-99502581-4e67-4180-af03-cf92f019fc91 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:26.357902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-99502581-4e67-4180-af03-cf92f019fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:26.365832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 691/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:26.412823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a5be-6b62-4f1d-a7de-fb5ca22ec2e0 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:26.428456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a5be-6b62-4f1d-a7de-fb5ca22ec2e0 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:26.434204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5388fe-23db-414e-b7ff-37aed30547e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:26.434880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5388fe-23db-414e-b7ff-37aed30547e9 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:26.435166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5388fe-23db-414e-b7ff-37aed30547e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:26.435448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5388fe-23db-414e-b7ff-37aed30547e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:26.445838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5388fe-23db-414e-b7ff-37aed30547e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:26.447484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5388fe-23db-414e-b7ff-37aed30547e9 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:26.459560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 672/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:28.968024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f523463-93d4-4a68-998c-8364b8e6411a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.968501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f523463-93d4-4a68-998c-8364b8e6411a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.968619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f523463-93d4-4a68-998c-8364b8e6411a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:28.969954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 692/1364] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:28.975661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c9ae1-1a08-468f-a372-86ac0a0e2edd None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:28.976120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c9ae1-1a08-468f-a372-86ac0a0e2edd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:28.976251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c9ae1-1a08-468f-a372-86ac0a0e2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.000363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-934c9ae1-1a08-468f-a372-86ac0a0e2edd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:29.001563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-934c9ae1-1a08-468f-a372-86ac0a0e2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:29.009704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 673/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:29.056844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f337-d007-45b2-ab0f-bf366171528a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.057410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f337-d007-45b2-ab0f-bf366171528a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.057898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7f337-d007-45b2-ab0f-bf366171528a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.059503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 693/1366] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 00:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:29.066528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549f4a0-44e2-4930-89dc-c6e9a5a65581 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.066897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549f4a0-44e2-4930-89dc-c6e9a5a65581 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.067350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549f4a0-44e2-4930-89dc-c6e9a5a65581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.089688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b549f4a0-44e2-4930-89dc-c6e9a5a65581 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:29.090884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b549f4a0-44e2-4930-89dc-c6e9a5a65581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:29.100962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 674/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 00:20:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:29.109342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7f337-d007-45b2-ab0f-bf366171528a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:29.123812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7f337-d007-45b2-ab0f-bf366171528a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:29.130005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21914468-5315-40da-b3a3-604cb52867c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:29.131184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914468-5315-40da-b3a3-604cb52867c2 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:29.131943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914468-5315-40da-b3a3-604cb52867c2 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:29.132773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914468-5315-40da-b3a3-604cb52867c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:29.143262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21914468-5315-40da-b3a3-604cb52867c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:29.144898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21914468-5315-40da-b3a3-604cb52867c2 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:29.155272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 694/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:31.369768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5de50-7d00-4619-9531-5687be165861 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.370366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5de50-7d00-4619-9531-5687be165861 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.370366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5de50-7d00-4619-9531-5687be165861 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.371959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 675/1369] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:31.377398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf05f3-6a2e-429b-aa40-6385fd9b71c1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.378218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf05f3-6a2e-429b-aa40-6385fd9b71c1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.378798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf05f3-6a2e-429b-aa40-6385fd9b71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.398239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4eaf05f3-6a2e-429b-aa40-6385fd9b71c1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:31.399603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4eaf05f3-6a2e-429b-aa40-6385fd9b71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:31.407453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 695/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:31.454058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5de50-7d00-4619-9531-5687be165861 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:31.470898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5de50-7d00-4619-9531-5687be165861 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:31.477041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83294-c85f-4063-81b2-17fc48d0b31a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:31.477796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83294-c85f-4063-81b2-17fc48d0b31a service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.478182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83294-c85f-4063-81b2-17fc48d0b31a service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.478562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83294-c85f-4063-81b2-17fc48d0b31a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.487736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83294-c85f-4063-81b2-17fc48d0b31a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:31.490013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83294-c85f-4063-81b2-17fc48d0b31a service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:31.500209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 676/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:31.927789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d97ff-cbe3-4132-ac91-3edd3b52593b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.928116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d97ff-cbe3-4132-ac91-3edd3b52593b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.928623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d97ff-cbe3-4132-ac91-3edd3b52593b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.930021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 696/1372] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:31.935265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d187-e8a6-47ec-ab85-265f42a691bd None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:31.935566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d187-e8a6-47ec-ab85-265f42a691bd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:31.935858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d187-e8a6-47ec-ab85-265f42a691bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:31.954672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-20f0d187-e8a6-47ec-ab85-265f42a691bd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:31.955933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-20f0d187-e8a6-47ec-ab85-265f42a691bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:31.964282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 677/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:32.272872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559ab9-443e-41d4-b222-93cc3060c19b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.272872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559ab9-443e-41d4-b222-93cc3060c19b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.272872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559ab9-443e-41d4-b222-93cc3060c19b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.274057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 697/1374] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 16 00:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:32.278340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bea14-f72e-43a4-8bf5-d9658c6f004e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.278640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bea14-f72e-43a4-8bf5-d9658c6f004e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.278961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bea14-f72e-43a4-8bf5-d9658c6f004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.331105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d75bea14-f72e-43a4-8bf5-d9658c6f004e None None] MFA Rules not processed for user `367573878e1d440594736c21e9a5497b`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:32.332353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d75bea14-f72e-43a4-8bf5-d9658c6f004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:32.397352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 678/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 16 00:20:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:32.404903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559ab9-443e-41d4-b222-93cc3060c19b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:32.417485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559ab9-443e-41d4-b222-93cc3060c19b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:32.421754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015de1-3c4d-46f5-8574-f7e0ca4733ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:32.422406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015de1-3c4d-46f5-8574-f7e0ca4733ed service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:32.422698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015de1-3c4d-46f5-8574-f7e0ca4733ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:32.422981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015de1-3c4d-46f5-8574-f7e0ca4733ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:32.434636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015de1-3c4d-46f5-8574-f7e0ca4733ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:32.436269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015de1-3c4d-46f5-8574-f7e0ca4733ed service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:32.448037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 698/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:33.701603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0790a-72dd-4269-8dc8-a7759c35ca72 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.702152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0790a-72dd-4269-8dc8-a7759c35ca72 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.702152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0790a-72dd-4269-8dc8-a7759c35ca72 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.703563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 679/1377] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:33.709424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490030a-37c2-41a4-9e12-4e8d4812e59e None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.709853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490030a-37c2-41a4-9e12-4e8d4812e59e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.710003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490030a-37c2-41a4-9e12-4e8d4812e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.727885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7490030a-37c2-41a4-9e12-4e8d4812e59e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:33.729091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7490030a-37c2-41a4-9e12-4e8d4812e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:33.740262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 699/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:33.782679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0790a-72dd-4269-8dc8-a7759c35ca72 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:33.802689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0790a-72dd-4269-8dc8-a7759c35ca72 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:33.809792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721897f-ba83-4dec-b489-a0936717379b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:33.810636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721897f-ba83-4dec-b489-a0936717379b service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:33.810932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721897f-ba83-4dec-b489-a0936717379b service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:33.811216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721897f-ba83-4dec-b489-a0936717379b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:33.821075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721897f-ba83-4dec-b489-a0936717379b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:33.822741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721897f-ba83-4dec-b489-a0936717379b service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:33.826771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:33.834974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 680/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:36.042582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78862-9fbd-4c24-aa5b-bb5adc5607de None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.043136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78862-9fbd-4c24-aa5b-bb5adc5607de None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.043136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78862-9fbd-4c24-aa5b-bb5adc5607de None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.044829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 700/1380] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:36.051447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341bee2-694e-4feb-9e81-c4f6f1a52a74 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.051447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341bee2-694e-4feb-9e81-c4f6f1a52a74 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.051969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341bee2-694e-4feb-9e81-c4f6f1a52a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.078402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c341bee2-694e-4feb-9e81-c4f6f1a52a74 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:36.081422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c341bee2-694e-4feb-9e81-c4f6f1a52a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:36.092369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 681/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:36.136516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78862-9fbd-4c24-aa5b-bb5adc5607de None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:36.151353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78862-9fbd-4c24-aa5b-bb5adc5607de None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:36.156705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c193-d614-4e5f-8347-1e04364ef95f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:36.157344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c193-d614-4e5f-8347-1e04364ef95f service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:36.157630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c193-d614-4e5f-8347-1e04364ef95f service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:36.157907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c193-d614-4e5f-8347-1e04364ef95f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:36.166503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c193-d614-4e5f-8347-1e04364ef95f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:36.168114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c193-d614-4e5f-8347-1e04364ef95f service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:36.178600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 701/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:38.363475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7486f-b594-4c69-b0f3-3214049f12ab None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.364001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7486f-b594-4c69-b0f3-3214049f12ab None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.364412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7486f-b594-4c69-b0f3-3214049f12ab None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.366075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 682/1383] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:38.371454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53b10-2d09-4bea-89ec-83e8251a3c02 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.371933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53b10-2d09-4bea-89ec-83e8251a3c02 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.372247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53b10-2d09-4bea-89ec-83e8251a3c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.391950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-36f53b10-2d09-4bea-89ec-83e8251a3c02 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:38.393425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-36f53b10-2d09-4bea-89ec-83e8251a3c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:38.402477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 702/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:38.445997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7486f-b594-4c69-b0f3-3214049f12ab None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:38.464868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7486f-b594-4c69-b0f3-3214049f12ab None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:38.470730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897f561-26dc-4023-973e-b32e2db73537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:38.471499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f561-26dc-4023-973e-b32e2db73537 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:38.471905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f561-26dc-4023-973e-b32e2db73537 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:38.472318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f561-26dc-4023-973e-b32e2db73537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:38.481885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897f561-26dc-4023-973e-b32e2db73537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:38.484084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897f561-26dc-4023-973e-b32e2db73537 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:38.495091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 683/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:40.642574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e401-5dc5-470a-85d1-d18f4678b1df None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.643167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e401-5dc5-470a-85d1-d18f4678b1df None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.643167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e401-5dc5-470a-85d1-d18f4678b1df None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.644713 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 703/1386] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:40.652120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553327e1-84cf-408c-aa69-7c6177ba43f8 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.652718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553327e1-84cf-408c-aa69-7c6177ba43f8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.653306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553327e1-84cf-408c-aa69-7c6177ba43f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.684663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-553327e1-84cf-408c-aa69-7c6177ba43f8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:40.686947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-553327e1-84cf-408c-aa69-7c6177ba43f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:40.701973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 684/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:40.751269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4e401-5dc5-470a-85d1-d18f4678b1df None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:40.767268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4e401-5dc5-470a-85d1-d18f4678b1df None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:40.773741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62368e1-c665-450d-94bf-4d12929b987b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:40.774388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62368e1-c665-450d-94bf-4d12929b987b service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:40.774679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62368e1-c665-450d-94bf-4d12929b987b service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:40.774964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62368e1-c665-450d-94bf-4d12929b987b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:40.783818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62368e1-c665-450d-94bf-4d12929b987b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:40.785462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62368e1-c665-450d-94bf-4d12929b987b service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:40.795488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 704/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:43.057194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6011289-9f66-43fa-b760-d033ffd32c83 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.057700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6011289-9f66-43fa-b760-d033ffd32c83 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.057795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6011289-9f66-43fa-b760-d033ffd32c83 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.059232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 685/1389] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:43.065043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493926c-522d-45c0-90c8-0c591573e8ce None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.065503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493926c-522d-45c0-90c8-0c591573e8ce None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.065752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493926c-522d-45c0-90c8-0c591573e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.085606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e493926c-522d-45c0-90c8-0c591573e8ce None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:43.086872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e493926c-522d-45c0-90c8-0c591573e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:43.095330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 705/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:43.139360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6011289-9f66-43fa-b760-d033ffd32c83 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:43.154536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6011289-9f66-43fa-b760-d033ffd32c83 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:43.160694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0653-ffa3-4a92-aa36-c32919390dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:43.161348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0653-ffa3-4a92-aa36-c32919390dfc service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:43.161639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0653-ffa3-4a92-aa36-c32919390dfc service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:43.161924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0653-ffa3-4a92-aa36-c32919390dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:43.171712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0653-ffa3-4a92-aa36-c32919390dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:43.173369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0653-ffa3-4a92-aa36-c32919390dfc service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:43.185841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 686/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:45.460425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388fa7-1044-4715-b3c1-d8afa0a53106 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.460954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388fa7-1044-4715-b3c1-d8afa0a53106 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.460954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388fa7-1044-4715-b3c1-d8afa0a53106 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.462349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 706/1392] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:45.467632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42640709-706b-48b0-b1e4-74e25b0fc73f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.468057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42640709-706b-48b0-b1e4-74e25b0fc73f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.468229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42640709-706b-48b0-b1e4-74e25b0fc73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.486834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-42640709-706b-48b0-b1e4-74e25b0fc73f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:45.488088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-42640709-706b-48b0-b1e4-74e25b0fc73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:45.496668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 687/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:45.550658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388fa7-1044-4715-b3c1-d8afa0a53106 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:45.565640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388fa7-1044-4715-b3c1-d8afa0a53106 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:45.572405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313948b8-eb30-4683-91c4-56a769ecd3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:45.573154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313948b8-eb30-4683-91c4-56a769ecd3f8 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:45.573449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313948b8-eb30-4683-91c4-56a769ecd3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:45.573771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313948b8-eb30-4683-91c4-56a769ecd3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:45.582590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313948b8-eb30-4683-91c4-56a769ecd3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:45.584365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313948b8-eb30-4683-91c4-56a769ecd3f8 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:45.594070 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 707/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:47.767758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ec672-0032-49f7-9c83-6c5d612d3795 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.768387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ec672-0032-49f7-9c83-6c5d612d3795 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.768387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ec672-0032-49f7-9c83-6c5d612d3795 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.770579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 688/1395] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:47.775289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.775715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.775859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.789898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde869d3-1074-4458-acda-8ea945cf692b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.790187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde869d3-1074-4458-acda-8ea945cf692b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.790470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde869d3-1074-4458-acda-8ea945cf692b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.791849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 689/1396] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:47.793968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:47.795174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:47.796906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047266d-e4a4-4c0a-a75d-365f04711465 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.797224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047266d-e4a4-4c0a-a75d-365f04711465 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.797505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047266d-e4a4-4c0a-a75d-365f04711465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.803848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 708/1397] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:47.817475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e047266d-e4a4-4c0a-a75d-365f04711465 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:47.818698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e047266d-e4a4-4c0a-a75d-365f04711465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:47.826494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 690/1398] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:47.847278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.860468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c3fd-ffae-4dc5-a543-883773d1b4ea None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.866624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.867260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.867550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.867832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.876687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:47.878264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:47.882622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781acb74-838b-4b8d-a353-b7b8bec5839e None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.883090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781acb74-838b-4b8d-a353-b7b8bec5839e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.883380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781acb74-838b-4b8d-a353-b7b8bec5839e None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.884780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 691/1399] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 16 00:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:47.888763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 709/1400] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:47.889814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715835d-0244-4626-a7ac-2eb92e1c34ef None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.890286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715835d-0244-4626-a7ac-2eb92e1c34ef None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.890576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715835d-0244-4626-a7ac-2eb92e1c34ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.943193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f715835d-0244-4626-a7ac-2eb92e1c34ef None None] MFA Rules not processed for user `1b964670153a46e7b5d41c5fae889860`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:47.944465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f715835d-0244-4626-a7ac-2eb92e1c34ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:48.014016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 692/1401] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:48.022308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:48.031780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206740-ba10-4763-81e9-0832ad3b6289 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:48.036083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a1195-7c96-4128-9589-762a45fe8579 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:48.036761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1195-7c96-4128-9589-762a45fe8579 service glance] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.037045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1195-7c96-4128-9589-762a45fe8579 service glance] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.037323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a1195-7c96-4128-9589-762a45fe8579 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.047347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1195-7c96-4128-9589-762a45fe8579 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:48.048960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a1195-7c96-4128-9589-762a45fe8579 service glance] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:48.061107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 710/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:48.785000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0a0ef-d252-437f-a23a-e8036b89eb84 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.786582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0a0ef-d252-437f-a23a-e8036b89eb84 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.786582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0a0ef-d252-437f-a23a-e8036b89eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.836657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-00f0a0ef-d252-437f-a23a-e8036b89eb84 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:48.837875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-00f0a0ef-d252-437f-a23a-e8036b89eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:48.893292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:48.903718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 693/1403] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:48.948862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41111-69e9-427f-ae8f-6275593c2ba1 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.949356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41111-69e9-427f-ae8f-6275593c2ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.949449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c41111-69e9-427f-ae8f-6275593c2ba1 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:48.950819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 711/1404] 10.222.0.39 () {54 vars in 942 bytes} [Thu Jun 16 00:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:48.957526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203784c2-24f9-4f5b-8d56-89f88055a5b7 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:48.957827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203784c2-24f9-4f5b-8d56-89f88055a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:48.958119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203784c2-24f9-4f5b-8d56-89f88055a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.007545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-203784c2-24f9-4f5b-8d56-89f88055a5b7 None None] MFA Rules not processed for user `0f7484f9ef764101977c9da152a7ab75`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:49.008789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-203784c2-24f9-4f5b-8d56-89f88055a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:49.083808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 694/1405] 10.222.0.39 () {58 vars in 1039 bytes} [Thu Jun 16 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:49.093467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41111-69e9-427f-ae8f-6275593c2ba1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.101535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=67 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:49.108811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c41111-69e9-427f-ae8f-6275593c2ba1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.114509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9ccf5-2975-4a6e-b078-7fc79e3ada25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.115160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ccf5-2975-4a6e-b078-7fc79e3ada25 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.115468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ccf5-2975-4a6e-b078-7fc79e3ada25 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.115753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ccf5-2975-4a6e-b078-7fc79e3ada25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.124145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9ccf5-2975-4a6e-b078-7fc79e3ada25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.125728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9ccf5-2975-4a6e-b078-7fc79e3ada25 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.133792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 712/1406] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:20:50.072689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b697fe1-f5b4-45f7-9a2d-6aaa08c892a1 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.073229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b697fe1-f5b4-45f7-9a2d-6aaa08c892a1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.073229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b697fe1-f5b4-45f7-9a2d-6aaa08c892a1 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.074764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 695/1407] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:50.079677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20683da3-c460-41a3-803b-a7728f7616c5 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.080142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20683da3-c460-41a3-803b-a7728f7616c5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.080293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20683da3-c460-41a3-803b-a7728f7616c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.101145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-20683da3-c460-41a3-803b-a7728f7616c5 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:50.102421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-20683da3-c460-41a3-803b-a7728f7616c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:50.110728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 713/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:50.155956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b697fe1-f5b4-45f7-9a2d-6aaa08c892a1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:50.172803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b697fe1-f5b4-45f7-9a2d-6aaa08c892a1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:50.179184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566b9fa-c00b-4c4d-a340-1d5dcf875a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:50.182746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566b9fa-c00b-4c4d-a340-1d5dcf875a4b service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:50.182746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566b9fa-c00b-4c4d-a340-1d5dcf875a4b service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:50.182746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566b9fa-c00b-4c4d-a340-1d5dcf875a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:50.191333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566b9fa-c00b-4c4d-a340-1d5dcf875a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:50.193676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566b9fa-c00b-4c4d-a340-1d5dcf875a4b service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:50.203625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 696/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:00.094673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=8 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.199517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=53 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:12.114652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef971-049a-486a-a2e0-959146d4f026 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.115226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef971-049a-486a-a2e0-959146d4f026 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.115226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bef971-049a-486a-a2e0-959146d4f026 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.116637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 714/1410] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 16 00:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:12.121898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3655-4fde-433f-bc46-3c9ad0599157 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.122304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3655-4fde-433f-bc46-3c9ad0599157 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.122463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3655-4fde-433f-bc46-3c9ad0599157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.140305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ed6e3655-4fde-433f-bc46-3c9ad0599157 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:12.141494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ed6e3655-4fde-433f-bc46-3c9ad0599157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:12.149864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 697/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 16 00:21:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:12.164385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7145-1817-450f-be6a-59442efd49c9 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.164684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7145-1817-450f-be6a-59442efd49c9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.164969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7145-1817-450f-be6a-59442efd49c9 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.166315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 715/1412] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 16 00:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:12.170805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95b3d-01eb-4fcf-9d8b-c35f493d050f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:12.171095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95b3d-01eb-4fcf-9d8b-c35f493d050f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:12.171379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be95b3d-01eb-4fcf-9d8b-c35f493d050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:12.189319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4be95b3d-01eb-4fcf-9d8b-c35f493d050f None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:12.190621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4be95b3d-01eb-4fcf-9d8b-c35f493d050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:12.199930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 698/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 16 00:21:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:14.792510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a7d2-85cc-467f-a0be-034295fd3bd7 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.793102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a7d2-85cc-467f-a0be-034295fd3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.793102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a7d2-85cc-467f-a0be-034295fd3bd7 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.794498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:14.800281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550720-5fa5-4531-bcc9-abebd4f613e6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.800750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550720-5fa5-4531-bcc9-abebd4f613e6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.800850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550720-5fa5-4531-bcc9-abebd4f613e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.819920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b9550720-5fa5-4531-bcc9-abebd4f613e6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:14.821119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b9550720-5fa5-4531-bcc9-abebd4f613e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:14.828927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:14.871795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a7d2-85cc-467f-a0be-034295fd3bd7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:14.887239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a7d2-85cc-467f-a0be-034295fd3bd7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:14.892537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820954d-aaf3-4ea5-b680-c9325f9edebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:14.893211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820954d-aaf3-4ea5-b680-c9325f9edebf service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:14.893568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820954d-aaf3-4ea5-b680-c9325f9edebf service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:14.893854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820954d-aaf3-4ea5-b680-c9325f9edebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:14.901920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820954d-aaf3-4ea5-b680-c9325f9edebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:14.903483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820954d-aaf3-4ea5-b680-c9325f9edebf service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:14.912772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 717/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:15.876706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a37b0-1fb4-4975-817e-e36fff662fc1 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.877282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a37b0-1fb4-4975-817e-e36fff662fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.877282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a37b0-1fb4-4975-817e-e36fff662fc1 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.879457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:21:15.884387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edff1b-43c0-48d1-9cf1-a864f6b14cd1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:15.884817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edff1b-43c0-48d1-9cf1-a864f6b14cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:15.884970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edff1b-43c0-48d1-9cf1-a864f6b14cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:15.905374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-92edff1b-43c0-48d1-9cf1-a864f6b14cd1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:15.906613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-92edff1b-43c0-48d1-9cf1-a864f6b14cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:15.916623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:16.077029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a37b0-1fb4-4975-817e-e36fff662fc1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:16.091496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a37b0-1fb4-4975-817e-e36fff662fc1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:16.097547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70c1e-050c-4adb-8b63-0d749947df38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:16.098195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70c1e-050c-4adb-8b63-0d749947df38 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:16.098481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70c1e-050c-4adb-8b63-0d749947df38 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:16.098762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70c1e-050c-4adb-8b63-0d749947df38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:16.107226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70c1e-050c-4adb-8b63-0d749947df38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:16.108829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70c1e-050c-4adb-8b63-0d749947df38 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:16.118868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 701/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:17.040137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b2a7-9764-4723-83eb-ec894c9cc611 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.040794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b2a7-9764-4723-83eb-ec894c9cc611 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.040794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b2a7-9764-4723-83eb-ec894c9cc611 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.042063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:17.046904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3596b63-14ba-466a-a5a1-40fe8d9f1413 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.047354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3596b63-14ba-466a-a5a1-40fe8d9f1413 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.047446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3596b63-14ba-466a-a5a1-40fe8d9f1413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.065787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f3596b63-14ba-466a-a5a1-40fe8d9f1413 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:17.066995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f3596b63-14ba-466a-a5a1-40fe8d9f1413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:17.074829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:17.226775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b2a7-9764-4723-83eb-ec894c9cc611 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:17.241944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b2a7-9764-4723-83eb-ec894c9cc611 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:17.247209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82f1cd-a493-4540-96b5-111d944321c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:17.247834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82f1cd-a493-4540-96b5-111d944321c0 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:17.248146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82f1cd-a493-4540-96b5-111d944321c0 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:17.248422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82f1cd-a493-4540-96b5-111d944321c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:17.257523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82f1cd-a493-4540-96b5-111d944321c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:17.259118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82f1cd-a493-4540-96b5-111d944321c0 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:17.268549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 720/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:18.202413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8d87-1347-4c91-ac21-3444df523678 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.202979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8d87-1347-4c91-ac21-3444df523678 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.202979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8d87-1347-4c91-ac21-3444df523678 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.204382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:18.209513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca5c2-9522-4efb-8928-faa463b7482e None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.209952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca5c2-9522-4efb-8928-faa463b7482e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.210077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca5c2-9522-4efb-8928-faa463b7482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.228093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-59cca5c2-9522-4efb-8928-faa463b7482e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:18.229266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-59cca5c2-9522-4efb-8928-faa463b7482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:18.237786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:18.389801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8d87-1347-4c91-ac21-3444df523678 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:18.404588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8d87-1347-4c91-ac21-3444df523678 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:18.410707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb9692-4209-4467-8108-3f5ec626c5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:18.411342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb9692-4209-4467-8108-3f5ec626c5e1 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:18.411623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb9692-4209-4467-8108-3f5ec626c5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:18.411925 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb9692-4209-4467-8108-3f5ec626c5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:18.419921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb9692-4209-4467-8108-3f5ec626c5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:18.421481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb9692-4209-4467-8108-3f5ec626c5e1 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:18.431145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 704/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:19.344923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489f29-f63e-4201-a093-95efed56f739 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.345566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489f29-f63e-4201-a093-95efed56f739 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.345566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489f29-f63e-4201-a093-95efed56f739 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.347452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:19.352459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856abe8-65d5-4a37-b56d-c456578026c4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.352892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856abe8-65d5-4a37-b56d-c456578026c4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.353008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856abe8-65d5-4a37-b56d-c456578026c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.371047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9856abe8-65d5-4a37-b56d-c456578026c4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:19.372280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9856abe8-65d5-4a37-b56d-c456578026c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:19.380040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:19.530078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b489f29-f63e-4201-a093-95efed56f739 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:19.544838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b489f29-f63e-4201-a093-95efed56f739 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:19.550162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297eb07-4a81-4c58-9221-e0456b67b0d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:19.550787 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297eb07-4a81-4c58-9221-e0456b67b0d7 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:19.551071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297eb07-4a81-4c58-9221-e0456b67b0d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:19.551347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297eb07-4a81-4c58-9221-e0456b67b0d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:19.559358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297eb07-4a81-4c58-9221-e0456b67b0d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:19.560956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297eb07-4a81-4c58-9221-e0456b67b0d7 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:19.570789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 723/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:20.415206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f6e1-c83f-4673-a438-a4678fd458c2 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.415738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f6e1-c83f-4673-a438-a4678fd458c2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.415738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f6e1-c83f-4673-a438-a4678fd458c2 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.417130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:20.422107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c544-a3a2-4b85-914e-bb64c8fef4f1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.422519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c544-a3a2-4b85-914e-bb64c8fef4f1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.422661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c544-a3a2-4b85-914e-bb64c8fef4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.441532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7ae2c544-a3a2-4b85-914e-bb64c8fef4f1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:20.442712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7ae2c544-a3a2-4b85-914e-bb64c8fef4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:20.450323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:20.602851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f6e1-c83f-4673-a438-a4678fd458c2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:20.617965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f6e1-c83f-4673-a438-a4678fd458c2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:20.623325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3998d-c960-4e2c-8f92-7a1564338613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:20.623998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3998d-c960-4e2c-8f92-7a1564338613 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:20.624289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3998d-c960-4e2c-8f92-7a1564338613 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:20.624573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3998d-c960-4e2c-8f92-7a1564338613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:20.632687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3998d-c960-4e2c-8f92-7a1564338613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:20.634257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3998d-c960-4e2c-8f92-7a1564338613 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:20.644141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 707/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:21.485783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcc02-93c7-41a1-a07d-a52b4bf01009 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.486299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcc02-93c7-41a1-a07d-a52b4bf01009 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.486299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcc02-93c7-41a1-a07d-a52b4bf01009 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.487772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:21.492704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde80b-a8e6-4297-a5e8-63af2ead7d73 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.493144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde80b-a8e6-4297-a5e8-63af2ead7d73 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.493252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde80b-a8e6-4297-a5e8-63af2ead7d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.511219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-aefde80b-a8e6-4297-a5e8-63af2ead7d73 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:21.512453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-aefde80b-a8e6-4297-a5e8-63af2ead7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:21.520785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:21.669838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfcc02-93c7-41a1-a07d-a52b4bf01009 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:21.683862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfcc02-93c7-41a1-a07d-a52b4bf01009 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:21.689159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6928c-bbd8-4b98-aa70-c344b044e508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:21.689829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6928c-bbd8-4b98-aa70-c344b044e508 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:21.690126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6928c-bbd8-4b98-aa70-c344b044e508 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:21.690404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6928c-bbd8-4b98-aa70-c344b044e508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:21.698353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6928c-bbd8-4b98-aa70-c344b044e508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:21.699960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6928c-bbd8-4b98-aa70-c344b044e508 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:21.709712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 726/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:22.584363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3aa77-89fe-4dd6-99b4-a8ee9d16ea76 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.584936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3aa77-89fe-4dd6-99b4-a8ee9d16ea76 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.585150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3aa77-89fe-4dd6-99b4-a8ee9d16ea76 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.586351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:22.591204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f571b79-e394-4f25-8bbc-d92db701e611 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.591614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f571b79-e394-4f25-8bbc-d92db701e611 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.591767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f571b79-e394-4f25-8bbc-d92db701e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.610838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3f571b79-e394-4f25-8bbc-d92db701e611 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:22.612807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3f571b79-e394-4f25-8bbc-d92db701e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:22.620486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:22.770983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3aa77-89fe-4dd6-99b4-a8ee9d16ea76 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:22.785581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3aa77-89fe-4dd6-99b4-a8ee9d16ea76 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:22.790878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5133ce-1549-4143-b82f-a717e5ad92d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:22.791507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5133ce-1549-4143-b82f-a717e5ad92d6 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:22.791794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5133ce-1549-4143-b82f-a717e5ad92d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:22.792101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5133ce-1549-4143-b82f-a717e5ad92d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:22.800852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5133ce-1549-4143-b82f-a717e5ad92d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:22.802406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5133ce-1549-4143-b82f-a717e5ad92d6 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:22.812146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 710/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:23.662804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c37c7-431f-4e66-a490-7edf5fcb52ae None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.663374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c37c7-431f-4e66-a490-7edf5fcb52ae None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.663374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c37c7-431f-4e66-a490-7edf5fcb52ae None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.664782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:23.669530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f61c-15e6-4b8d-8b64-19c21e8baa06 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.669944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f61c-15e6-4b8d-8b64-19c21e8baa06 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.670099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f61c-15e6-4b8d-8b64-19c21e8baa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.688285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e967f61c-15e6-4b8d-8b64-19c21e8baa06 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:23.689490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e967f61c-15e6-4b8d-8b64-19c21e8baa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:23.697923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:23.850425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c37c7-431f-4e66-a490-7edf5fcb52ae None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:23.864889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c37c7-431f-4e66-a490-7edf5fcb52ae None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:23.870166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416788-acdb-4990-866a-9afca87e8feb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:23.870794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416788-acdb-4990-866a-9afca87e8feb service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:23.871082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416788-acdb-4990-866a-9afca87e8feb service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:23.871361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416788-acdb-4990-866a-9afca87e8feb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:23.879295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82416788-acdb-4990-866a-9afca87e8feb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:23.880904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82416788-acdb-4990-866a-9afca87e8feb service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:23.890052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 729/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:25.887632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c4cc1-80fa-4edc-ade7-6b3121bcf4c2 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.888198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c4cc1-80fa-4edc-ade7-6b3121bcf4c2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.888198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c4cc1-80fa-4edc-ade7-6b3121bcf4c2 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.889587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:25.895369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b3a2-4efa-4d07-a98a-51cf4a0db3c8 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.895759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b3a2-4efa-4d07-a98a-51cf4a0db3c8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.895977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b3a2-4efa-4d07-a98a-51cf4a0db3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.913113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-9424b3a2-4efa-4d07-a98a-51cf4a0db3c8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:25.914281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9424b3a2-4efa-4d07-a98a-51cf4a0db3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:25.921909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:25.961721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c4cc1-80fa-4edc-ade7-6b3121bcf4c2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:25.972820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c4cc1-80fa-4edc-ade7-6b3121bcf4c2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:25.976281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aa3a6-6c1c-4c13-9d40-11a18603f957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:25.976917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa3a6-6c1c-4c13-9d40-11a18603f957 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:25.977202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa3a6-6c1c-4c13-9d40-11a18603f957 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:25.977479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa3a6-6c1c-4c13-9d40-11a18603f957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:25.987393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6aa3a6-6c1c-4c13-9d40-11a18603f957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:25.988845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6aa3a6-6c1c-4c13-9d40-11a18603f957 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:25.998034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 713/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:28.334693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5134-b3bf-40ed-9b84-173d22e6f125 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.335204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5134-b3bf-40ed-9b84-173d22e6f125 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.335204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5134-b3bf-40ed-9b84-173d22e6f125 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.336630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:28.341805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf8cf4-0d1e-4667-8475-1bee1fac9571 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.342217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf8cf4-0d1e-4667-8475-1bee1fac9571 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.342376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf8cf4-0d1e-4667-8475-1bee1fac9571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.360233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8ddf8cf4-0d1e-4667-8475-1bee1fac9571 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:28.361933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8ddf8cf4-0d1e-4667-8475-1bee1fac9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:28.369733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:28.409080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5134-b3bf-40ed-9b84-173d22e6f125 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:28.410792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8a2c5134-b3bf-40ed-9b84-173d22e6f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:28.423434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5134-b3bf-40ed-9b84-173d22e6f125 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:28.427414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4266e-7f25-4e77-922d-e205ef1a2767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:28.428084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4266e-7f25-4e77-922d-e205ef1a2767 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:28.428368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4266e-7f25-4e77-922d-e205ef1a2767 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:28.428647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4266e-7f25-4e77-922d-e205ef1a2767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:28.437374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4266e-7f25-4e77-922d-e205ef1a2767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:28.438797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4266e-7f25-4e77-922d-e205ef1a2767 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:28.450824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 732/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:30.946458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3eab-a2b1-4477-a1eb-906bd0a61f91 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.947005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3eab-a2b1-4477-a1eb-906bd0a61f91 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.947108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3eab-a2b1-4477-a1eb-906bd0a61f91 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.948640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:30.953890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e202d-9351-42e1-be8d-2cd3dd52dadf None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:30.954329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e202d-9351-42e1-be8d-2cd3dd52dadf None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:30.954455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e202d-9351-42e1-be8d-2cd3dd52dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:30.972341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0f4e202d-9351-42e1-be8d-2cd3dd52dadf None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:30.973510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0f4e202d-9351-42e1-be8d-2cd3dd52dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:30.981072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:31.020436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3eab-a2b1-4477-a1eb-906bd0a61f91 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:31.030994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3eab-a2b1-4477-a1eb-906bd0a61f91 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:31.035164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9bd5-f1da-4e5d-a7ce-7db0b4849e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:31.035799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9bd5-f1da-4e5d-a7ce-7db0b4849e48 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:31.036116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9bd5-f1da-4e5d-a7ce-7db0b4849e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:31.036403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9bd5-f1da-4e5d-a7ce-7db0b4849e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:31.045332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9bd5-f1da-4e5d-a7ce-7db0b4849e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:31.046773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9bd5-f1da-4e5d-a7ce-7db0b4849e48 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:31.057210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 716/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:33.292381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073449cf-9f8f-44cb-8fa5-24abde330c1e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.292917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073449cf-9f8f-44cb-8fa5-24abde330c1e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.292917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073449cf-9f8f-44cb-8fa5-24abde330c1e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.294312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:33.300206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d99255-5638-4c98-aaba-0aa6ab1fa234 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.300600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d99255-5638-4c98-aaba-0aa6ab1fa234 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.300831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d99255-5638-4c98-aaba-0aa6ab1fa234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.319216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-24d99255-5638-4c98-aaba-0aa6ab1fa234 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:33.320439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-24d99255-5638-4c98-aaba-0aa6ab1fa234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:33.328052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:33.365778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073449cf-9f8f-44cb-8fa5-24abde330c1e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:33.376378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073449cf-9f8f-44cb-8fa5-24abde330c1e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:33.380412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a35a5-457a-4ec0-839e-0c4de35788a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:33.381047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a35a5-457a-4ec0-839e-0c4de35788a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:33.381336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a35a5-457a-4ec0-839e-0c4de35788a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:33.381619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a35a5-457a-4ec0-839e-0c4de35788a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:33.390533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a35a5-457a-4ec0-839e-0c4de35788a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:33.391991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a35a5-457a-4ec0-839e-0c4de35788a0 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:33.402019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 735/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:35.591998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069184f-f1a2-42fc-8c20-f9f85ac0620a None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.592545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069184f-f1a2-42fc-8c20-f9f85ac0620a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.592545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069184f-f1a2-42fc-8c20-f9f85ac0620a None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.593962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:35.599643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b5a2-cfb9-4074-aad8-bcdfca99e8d9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.600085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b5a2-cfb9-4074-aad8-bcdfca99e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.600286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b5a2-cfb9-4074-aad8-bcdfca99e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.617869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-89a6b5a2-cfb9-4074-aad8-bcdfca99e8d9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:35.619056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-89a6b5a2-cfb9-4074-aad8-bcdfca99e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:35.627394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:35.665131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069184f-f1a2-42fc-8c20-f9f85ac0620a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:35.676215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069184f-f1a2-42fc-8c20-f9f85ac0620a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:35.679760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e457d1-63ac-4b0c-a60b-8be2c003af7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:35.680425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e457d1-63ac-4b0c-a60b-8be2c003af7d service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:35.680719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e457d1-63ac-4b0c-a60b-8be2c003af7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:35.681006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e457d1-63ac-4b0c-a60b-8be2c003af7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:35.690659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e457d1-63ac-4b0c-a60b-8be2c003af7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:35.692122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e457d1-63ac-4b0c-a60b-8be2c003af7d service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:35.701631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 719/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:37.872793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d3ad-385b-4bdd-8abf-2fc5a9a57382 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:37.873370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d3ad-385b-4bdd-8abf-2fc5a9a57382 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:37.873370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d3ad-385b-4bdd-8abf-2fc5a9a57382 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:37.874733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:37.880045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f520-99b3-4e92-8643-987dae7ab07b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:37.880473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f520-99b3-4e92-8643-987dae7ab07b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:37.880594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f520-99b3-4e92-8643-987dae7ab07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:37.898604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4e24f520-99b3-4e92-8643-987dae7ab07b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:37.899796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4e24f520-99b3-4e92-8643-987dae7ab07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:37.907442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:37.945677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d3ad-385b-4bdd-8abf-2fc5a9a57382 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:37.957326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d3ad-385b-4bdd-8abf-2fc5a9a57382 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:37.960900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7934cd7-8b79-4ba9-b1a0-a0d5aa85ccc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:37.961533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934cd7-8b79-4ba9-b1a0-a0d5aa85ccc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:37.961821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934cd7-8b79-4ba9-b1a0-a0d5aa85ccc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:37.962100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934cd7-8b79-4ba9-b1a0-a0d5aa85ccc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:37.972060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7934cd7-8b79-4ba9-b1a0-a0d5aa85ccc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:37.973493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7934cd7-8b79-4ba9-b1a0-a0d5aa85ccc4 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:37.982947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 738/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:40.143853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e8fad-c8db-415e-bfb2-af87766c37b6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:40.144425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e8fad-c8db-415e-bfb2-af87766c37b6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:40.144519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e8fad-c8db-415e-bfb2-af87766c37b6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:40.145913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:40.151176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576682d1-28c2-4824-b58b-4054f0f4130e None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:40.151651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576682d1-28c2-4824-b58b-4054f0f4130e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:40.151749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576682d1-28c2-4824-b58b-4054f0f4130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:40.157691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=70 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:40.170294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-576682d1-28c2-4824-b58b-4054f0f4130e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:40.171490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-576682d1-28c2-4824-b58b-4054f0f4130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:40.179742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:40.216658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e8fad-c8db-415e-bfb2-af87766c37b6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:40.222464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=73 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:40.229066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e8fad-c8db-415e-bfb2-af87766c37b6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:40.233050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5c4d4-d769-4d3b-abe4-51fa3293d99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:40.233685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c4d4-d769-4d3b-abe4-51fa3293d99f service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:40.233982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c4d4-d769-4d3b-abe4-51fa3293d99f service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:40.234263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c4d4-d769-4d3b-abe4-51fa3293d99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:40.243862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5c4d4-d769-4d3b-abe4-51fa3293d99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:40.245310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5c4d4-d769-4d3b-abe4-51fa3293d99f service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:40.255313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 722/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:42.419857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf6ec6-10a2-4a6d-8e8a-ddbb7493a298 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.420507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf6ec6-10a2-4a6d-8e8a-ddbb7493a298 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.420507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf6ec6-10a2-4a6d-8e8a-ddbb7493a298 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.421773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:42.427713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d2827-5ac8-473a-85c8-afd000ee4e3a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.428170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d2827-5ac8-473a-85c8-afd000ee4e3a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.428303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d2827-5ac8-473a-85c8-afd000ee4e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.446548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e19d2827-5ac8-473a-85c8-afd000ee4e3a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:42.447737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e19d2827-5ac8-473a-85c8-afd000ee4e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:42.456148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:21:42.493093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf6ec6-10a2-4a6d-8e8a-ddbb7493a298 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:42.504434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf6ec6-10a2-4a6d-8e8a-ddbb7493a298 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:42.507944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fffad-02a2-4bbd-b164-5fbf6ab3fb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:42.508580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fffad-02a2-4bbd-b164-5fbf6ab3fb4b service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:42.508868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fffad-02a2-4bbd-b164-5fbf6ab3fb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:42.509149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fffad-02a2-4bbd-b164-5fbf6ab3fb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:42.518939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fffad-02a2-4bbd-b164-5fbf6ab3fb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:42.520404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fffad-02a2-4bbd-b164-5fbf6ab3fb4b service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:42.529565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 741/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:44.685774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720099c-0c89-4a92-9e2e-1029cbac111b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.686318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720099c-0c89-4a92-9e2e-1029cbac111b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.686318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720099c-0c89-4a92-9e2e-1029cbac111b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.687706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:44.693678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc33a-db7b-4cbc-b392-a7f34eb211f9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.694136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc33a-db7b-4cbc-b392-a7f34eb211f9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.694263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc33a-db7b-4cbc-b392-a7f34eb211f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.711392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-991bc33a-db7b-4cbc-b392-a7f34eb211f9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:44.712595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-991bc33a-db7b-4cbc-b392-a7f34eb211f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:44.720311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:44.757801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720099c-0c89-4a92-9e2e-1029cbac111b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:44.768391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720099c-0c89-4a92-9e2e-1029cbac111b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:44.771800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fbe46-185f-4b83-a009-cb4911c0dff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:44.772469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbe46-185f-4b83-a009-cb4911c0dff7 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:44.772782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbe46-185f-4b83-a009-cb4911c0dff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:44.773064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fbe46-185f-4b83-a009-cb4911c0dff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:44.781789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fbe46-185f-4b83-a009-cb4911c0dff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:44.783296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fbe46-185f-4b83-a009-cb4911c0dff7 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:44.792496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 725/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:46.933727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33187f4-673a-4821-b871-e8251a502fa7 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:46.934305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33187f4-673a-4821-b871-e8251a502fa7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:46.934305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33187f4-673a-4821-b871-e8251a502fa7 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:46.935660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:46.941014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f230-e86c-4f4d-9576-189acb043060 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:46.941397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f230-e86c-4f4d-9576-189acb043060 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:46.941564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f230-e86c-4f4d-9576-189acb043060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:46.959360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f199f230-e86c-4f4d-9576-189acb043060 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:46.960575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f199f230-e86c-4f4d-9576-189acb043060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:46.968161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:47.004236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33187f4-673a-4821-b871-e8251a502fa7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:47.014554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33187f4-673a-4821-b871-e8251a502fa7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:47.018565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e3992-0961-457c-b7cc-41838ff3a521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:47.019188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3992-0961-457c-b7cc-41838ff3a521 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:47.019473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3992-0961-457c-b7cc-41838ff3a521 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:47.019750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3992-0961-457c-b7cc-41838ff3a521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:47.028471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e3992-0961-457c-b7cc-41838ff3a521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:47.029887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e3992-0961-457c-b7cc-41838ff3a521 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:47.039583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 744/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:56.954493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=17 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:57.035567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=17 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:07.147061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33ee90-77c8-4ae5-8c0f-6f815d3b5e60 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.147538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33ee90-77c8-4ae5-8c0f-6f815d3b5e60 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.147645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33ee90-77c8-4ae5-8c0f-6f815d3b5e60 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.149036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 727/1471] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:07.154249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989295f0-ec62-4c3c-bb7d-8e7210667e01 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.154686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989295f0-ec62-4c3c-bb7d-8e7210667e01 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.154821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989295f0-ec62-4c3c-bb7d-8e7210667e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.172968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-989295f0-ec62-4c3c-bb7d-8e7210667e01 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:07.174216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-989295f0-ec62-4c3c-bb7d-8e7210667e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:07.181870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 745/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:07.228030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5743ca-e7e7-4b40-be38-96bbe5ebf6e9 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.228329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5743ca-e7e7-4b40-be38-96bbe5ebf6e9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.228611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5743ca-e7e7-4b40-be38-96bbe5ebf6e9 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.229975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 728/1473] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 16 00:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:07.235648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8220c-f6df-4d07-a8cb-a6aa7939182a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.235985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8220c-f6df-4d07-a8cb-a6aa7939182a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.236266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8220c-f6df-4d07-a8cb-a6aa7939182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.254383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-37c8220c-f6df-4d07-a8cb-a6aa7939182a None None] MFA Rules not processed for user `1b964670153a46e7b5d41c5fae889860`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:07.255555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-37c8220c-f6df-4d07-a8cb-a6aa7939182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:07.261868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 746/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 16 00:22:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:07.270021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5743ca-e7e7-4b40-be38-96bbe5ebf6e9 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:07.280618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5743ca-e7e7-4b40-be38-96bbe5ebf6e9 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:07.284201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23549427-6cd7-443e-a406-882c15ca9d73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:07.284862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549427-6cd7-443e-a406-882c15ca9d73 service glance] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:07.285181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549427-6cd7-443e-a406-882c15ca9d73 service glance] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:07.285465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23549427-6cd7-443e-a406-882c15ca9d73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:07.294337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23549427-6cd7-443e-a406-882c15ca9d73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:07.295753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23549427-6cd7-443e-a406-882c15ca9d73 service glance] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:07.305703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 729/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:09.517596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc44b7-bab5-4657-b9b2-70c01cda765a None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:09.518155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc44b7-bab5-4657-b9b2-70c01cda765a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:09.518375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc44b7-bab5-4657-b9b2-70c01cda765a None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:09.519847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 747/1476] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:09.524947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfe3d5-54df-4a15-b577-1c91dbc09a72 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:09.525375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfe3d5-54df-4a15-b577-1c91dbc09a72 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:09.525513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfe3d5-54df-4a15-b577-1c91dbc09a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:09.542832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6ecfe3d5-54df-4a15-b577-1c91dbc09a72 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:09.544072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6ecfe3d5-54df-4a15-b577-1c91dbc09a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:09.552338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 730/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:09.576078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc44b7-bab5-4657-b9b2-70c01cda765a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:09.588594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc44b7-bab5-4657-b9b2-70c01cda765a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:09.592928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:09.593591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:09.593871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:09.594428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:09.594950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:09.596754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:09.596754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:22:09.596754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:22:09.597916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5adff2-6240-4641-a9dd-5e68de6b84b8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:09.617170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 748/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 16 00:22:09 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:22:11.772804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b5a4-36bc-456b-8634-e98dc280e1b3 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:11.773338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b5a4-36bc-456b-8634-e98dc280e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:11.773455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b5a4-36bc-456b-8634-e98dc280e1b3 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:11.774748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 731/1479] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:11.779904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6ff28-fb0a-45c2-ae22-44559748d257 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:11.780322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6ff28-fb0a-45c2-ae22-44559748d257 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:11.780550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6ff28-fb0a-45c2-ae22-44559748d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:11.799632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-26f6ff28-fb0a-45c2-ae22-44559748d257 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:11.800899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-26f6ff28-fb0a-45c2-ae22-44559748d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:11.808659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 749/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:11.852649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b5a4-36bc-456b-8634-e98dc280e1b3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:11.867764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b5a4-36bc-456b-8634-e98dc280e1b3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:11.873162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604929a6-b7b7-4d6c-9b17-669eff4c3ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:11.873806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604929a6-b7b7-4d6c-9b17-669eff4c3ae8 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:11.874099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604929a6-b7b7-4d6c-9b17-669eff4c3ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:11.874382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604929a6-b7b7-4d6c-9b17-669eff4c3ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:11.882693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604929a6-b7b7-4d6c-9b17-669eff4c3ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:11.884298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604929a6-b7b7-4d6c-9b17-669eff4c3ae8 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:11.894193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 732/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:14.204697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af9ca-58e2-4891-93f1-037c079daa2b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:14.205246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af9ca-58e2-4891-93f1-037c079daa2b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:14.205246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af9ca-58e2-4891-93f1-037c079daa2b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:14.206638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 750/1482] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:14.211858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb47dec-6e64-4e11-a0cf-1818264cd54e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:14.212338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb47dec-6e64-4e11-a0cf-1818264cd54e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:14.212434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb47dec-6e64-4e11-a0cf-1818264cd54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:14.229795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7eb47dec-6e64-4e11-a0cf-1818264cd54e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:14.231247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7eb47dec-6e64-4e11-a0cf-1818264cd54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:14.239324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 733/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:14.275551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af9ca-58e2-4891-93f1-037c079daa2b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:14.287096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af9ca-58e2-4891-93f1-037c079daa2b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:14.290587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6e7d7-f8d5-43b3-a527-e2c618057a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:14.291221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6e7d7-f8d5-43b3-a527-e2c618057a5b service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:14.291506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6e7d7-f8d5-43b3-a527-e2c618057a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:14.291785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6e7d7-f8d5-43b3-a527-e2c618057a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:14.301868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6e7d7-f8d5-43b3-a527-e2c618057a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:14.303247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6e7d7-f8d5-43b3-a527-e2c618057a5b service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:14.312837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 751/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:16.496348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6f7e-ed6b-4d34-8424-c38a40d14b92 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.496884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6f7e-ed6b-4d34-8424-c38a40d14b92 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.496884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6f7e-ed6b-4d34-8424-c38a40d14b92 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.498286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 734/1485] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:16.503571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de7e6c-629c-4c2c-9932-8cd61b6ff467 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.504009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de7e6c-629c-4c2c-9932-8cd61b6ff467 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.504184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de7e6c-629c-4c2c-9932-8cd61b6ff467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.522387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-91de7e6c-629c-4c2c-9932-8cd61b6ff467 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:16.523569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-91de7e6c-629c-4c2c-9932-8cd61b6ff467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:16.532002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 752/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:16.569563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6f7e-ed6b-4d34-8424-c38a40d14b92 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:16.580943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6f7e-ed6b-4d34-8424-c38a40d14b92 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:16.584410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e20b-fc03-4c86-95f0-28fd3dc3f1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:16.585039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e20b-fc03-4c86-95f0-28fd3dc3f1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:16.585325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e20b-fc03-4c86-95f0-28fd3dc3f1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:16.585609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e20b-fc03-4c86-95f0-28fd3dc3f1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:16.594476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e20b-fc03-4c86-95f0-28fd3dc3f1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:16.595908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e20b-fc03-4c86-95f0-28fd3dc3f1f5 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:16.605607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 735/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:18.831537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60ec8-9baf-4266-9dc4-a0664a3b01c1 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:18.832231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60ec8-9baf-4266-9dc4-a0664a3b01c1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:18.832231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60ec8-9baf-4266-9dc4-a0664a3b01c1 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:18.833560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 753/1488] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:18.838624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f64db-234b-4785-9025-49c4f94f9b64 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:18.839035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f64db-234b-4785-9025-49c4f94f9b64 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:18.839196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f64db-234b-4785-9025-49c4f94f9b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:18.857952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-274f64db-234b-4785-9025-49c4f94f9b64 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:18.859234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-274f64db-234b-4785-9025-49c4f94f9b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:18.867504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 736/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:18.906733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60ec8-9baf-4266-9dc4-a0664a3b01c1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:18.917518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60ec8-9baf-4266-9dc4-a0664a3b01c1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:18.921016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e0f1-5512-4098-97e7-172828d8d726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:18.922339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e0f1-5512-4098-97e7-172828d8d726 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:18.922658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e0f1-5512-4098-97e7-172828d8d726 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:18.922943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e0f1-5512-4098-97e7-172828d8d726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:18.931796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e0f1-5512-4098-97e7-172828d8d726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:18.933267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e0f1-5512-4098-97e7-172828d8d726 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:18.942915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 754/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:21.290969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2924-c274-4d21-a22e-9d4cf49d393b None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:21.291554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2924-c274-4d21-a22e-9d4cf49d393b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:21.291554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2924-c274-4d21-a22e-9d4cf49d393b None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:21.292918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 737/1491] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 16 00:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:21.298829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755319-4687-4c3f-bd24-9a35f7234ca6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:21.299279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755319-4687-4c3f-bd24-9a35f7234ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:21.299437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755319-4687-4c3f-bd24-9a35f7234ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:21.318068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6f755319-4687-4c3f-bd24-9a35f7234ca6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:21.319190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6f755319-4687-4c3f-bd24-9a35f7234ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:21.326960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 755/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 16 00:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:21.365414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2924-c274-4d21-a22e-9d4cf49d393b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:21.376046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2924-c274-4d21-a22e-9d4cf49d393b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:21.379468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de40a23-8c38-47fb-a17c-5b18795d3036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:21.380145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de40a23-8c38-47fb-a17c-5b18795d3036 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:21.380425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de40a23-8c38-47fb-a17c-5b18795d3036 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:21.380702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de40a23-8c38-47fb-a17c-5b18795d3036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:21.389408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de40a23-8c38-47fb-a17c-5b18795d3036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:21.391728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de40a23-8c38-47fb-a17c-5b18795d3036 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:21.401432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 738/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:31.311809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=33 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:31.397117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=33 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:45.952829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.953427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.953532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:45.971647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:45.972876 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:45.981604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 756/1494] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:45.990833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:45.991319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:45.991427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.009055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:46.010248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:46.018510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 739/1495] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:23:46.023043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.033381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ebd9-ca72-4d1d-93f9-1d3de9275e3b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.037747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.038390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.038673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.038952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.039668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:23:46.040002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.041034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.041034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:23:46.041034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:23:46.041907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.055296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 757/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:23:46.063599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.072919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc2aa6-f51b-45ca-ab03-e18ae956976a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.077758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.078411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.078704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.078989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.079690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.081517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.081517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:23:46.081517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:23:46.082734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.119652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 740/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:23:46 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:23:46.124013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.133894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33335b35-747e-4228-8838-22ed27d20897 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.190645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.191319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.191609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.191913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.192596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.193619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.193619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:23:46.193619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:23:46.194811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.214613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 758/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:23:46 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:23:46.219403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.229667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dfbc4-549b-403d-b576-f13388b30d5b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.235091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.235756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.236072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.236359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.237101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.238104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.238104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:23:46.238104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:23:46.238996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.252448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 741/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:23:46.256501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.266390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59090b-e86a-4061-848a-c76517f54f53 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.271178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.271833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.272151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.272436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.273165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.274183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.274183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:23:46.274183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:23:46.275067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623852c5-b2f6-485d-8102-51a8f65a405f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.288297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 759/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:23:46.292464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.302799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5b53f-08a1-42a8-8d23-914282d67340 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.307293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.308204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.308490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.308771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] PATH_INFO: `/v3/projects/a932924b645d4bbab8ec437032755265/users/3cfcaade2c61474db5eff0689988b7a2/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.324427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a932924b645d4bbab8ec437032755265, user_id=3cfcaade2c61474db5eff0689988b7a2, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.326164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.326164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:23:46.326164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:23:46.328136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba95039-f4b1-4f35-96ca-daf5c19652ce admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.341319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 742/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:23:46 2022] PUT /identity/v3/projects/a932924b645d4bbab8ec437032755265/users/3cfcaade2c61474db5eff0689988b7a2/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:23:46.352759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05056b7-570f-4232-b783-0eba30218b1b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.353054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05056b7-570f-4232-b783-0eba30218b1b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.353437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05056b7-570f-4232-b783-0eba30218b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.379836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d05056b7-570f-4232-b783-0eba30218b1b None None] MFA Rules not processed for user `3cfcaade2c61474db5eff0689988b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:46.381057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d05056b7-570f-4232-b783-0eba30218b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:46.444006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 760/1502] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:23:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:46.458045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9bbb7-edb3-43db-9936-7669a8302d41 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.458341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9bbb7-edb3-43db-9936-7669a8302d41 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.458625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9bbb7-edb3-43db-9936-7669a8302d41 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.460020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 743/1503] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 16 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:46.464972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd60b-9616-4d7e-a564-f821bf755113 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.465907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd60b-9616-4d7e-a564-f821bf755113 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.466303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd60b-9616-4d7e-a564-f821bf755113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.486960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-843cd60b-9616-4d7e-a564-f821bf755113 None None] MFA Rules not processed for user `367573878e1d440594736c21e9a5497b`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:46.488191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-843cd60b-9616-4d7e-a564-f821bf755113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:46.534047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:46.542471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 761/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 16 00:23:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:46.550371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9bbb7-edb3-43db-9936-7669a8302d41 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.561548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9bbb7-edb3-43db-9936-7669a8302d41 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.565195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.565864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.566153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.566433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.576065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.577497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.586304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 744/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:46.628742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ffe80-236d-4d53-b2b4-f30883cbb5e0 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.629042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ffe80-236d-4d53-b2b4-f30883cbb5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.629324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ffe80-236d-4d53-b2b4-f30883cbb5e0 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.630625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 762/1506] 10.222.0.39 () {52 vars in 829 bytes} [Thu Jun 16 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:46.634137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.695344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7b3c-7828-443e-9b09-5a23573f8e57 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.700592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.701583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.701867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.702145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] PATH_INFO: `/v3/users/3cfcaade2c61474db5eff0689988b7a2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.703474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfcaade2c61474db5eff0689988b7a2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.704558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:46.704558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:23:46.704558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:23:46.705807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.770644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfcaade2c61474db5eff0689988b7a2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:46.780049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfcaade2c61474db5eff0689988b7a2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:46.791788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfcaade2c61474db5eff0689988b7a2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:46.792473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfcaade2c61474db5eff0689988b7a2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:46.793199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfcaade2c61474db5eff0689988b7a2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:46.810529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:46.820456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 745/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:23:46 2022] DELETE /identity/v3/users/3cfcaade2c61474db5eff0689988b7a2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:23:46.825727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.826040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.826325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.843360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:46.844591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:46.902825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 763/1508] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:46.913320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:46.914757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:46.972088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b146e21-eb24-4839-8451-a3be3e341dd6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:46.975680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8611-7bab-4ed9-baa9-4c67db3bf0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:46.976367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8611-7bab-4ed9-baa9-4c67db3bf0ad service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:46.976661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8611-7bab-4ed9-baa9-4c67db3bf0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:46.976950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8611-7bab-4ed9-baa9-4c67db3bf0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:46.986612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8611-7bab-4ed9-baa9-4c67db3bf0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:46.988088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8611-7bab-4ed9-baa9-4c67db3bf0ad service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:46.998059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 746/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:47.417149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:47.419271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:47.431179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c2cd-be7c-4855-b74f-fdf28607482f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:47.436735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:47.437598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:47.437888 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:47.438170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] PATH_INFO: `/v3/projects/a932924b645d4bbab8ec437032755265` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:47.439388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a932924b645d4bbab8ec437032755265)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:47.440406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:23:47.440406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:23:47.440406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:23:47.441626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:47.503445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a932924b645d4bbab8ec437032755265', 'request_id': 'req-1a3796dd-a304-4193-95a4-800f984eab11'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:47.509586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a932924b645d4bbab8ec437032755265', 'request_id': 'req-1a3796dd-a304-4193-95a4-800f984eab11'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:47.524969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a932924b645d4bbab8ec437032755265', 'request_id': 'req-1a3796dd-a304-4193-95a4-800f984eab11'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:47.540214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] The token cache is being invalidate because project a932924b645d4bbab8ec437032755265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:23:47.540511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:47.541142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1a3796dd-a304-4193-95a4-800f984eab11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:23:47.543005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 764/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:23:47 2022] DELETE /identity/v3/projects/a932924b645d4bbab8ec437032755265 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:23:56.993271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:57.537153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:31.389044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5dcf7-56d0-48e8-b9ca-f7a1b1347237 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.389684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5dcf7-56d0-48e8-b9ca-f7a1b1347237 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.389981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5dcf7-56d0-48e8-b9ca-f7a1b1347237 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.391437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:25:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:31.396803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485196e-f4ed-4b66-a57e-e03f0921d18f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.397251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485196e-f4ed-4b66-a57e-e03f0921d18f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.397442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485196e-f4ed-4b66-a57e-e03f0921d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.419897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-1485196e-f4ed-4b66-a57e-e03f0921d18f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:31.421133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1485196e-f4ed-4b66-a57e-e03f0921d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:31.480037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:31.662515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5dcf7-56d0-48e8-b9ca-f7a1b1347237 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:31.664438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d0d5dcf7-56d0-48e8-b9ca-f7a1b1347237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:31.738048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5dcf7-56d0-48e8-b9ca-f7a1b1347237 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:31.743341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab78e4-7cd7-4e28-a244-722642b6d776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:31.744006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab78e4-7cd7-4e28-a244-722642b6d776 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.744889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab78e4-7cd7-4e28-a244-722642b6d776 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.745254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab78e4-7cd7-4e28-a244-722642b6d776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.753172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab78e4-7cd7-4e28-a244-722642b6d776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:31.754748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab78e4-7cd7-4e28-a244-722642b6d776 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:31.764229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 748/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:32.649301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c7f2-e0b6-4c04-a721-e6a987a5393f None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:32.649869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c7f2-e0b6-4c04-a721-e6a987a5393f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:32.649869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4c7f2-e0b6-4c04-a721-e6a987a5393f None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:32.651510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:32.656463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7f197-dff6-42ec-a6de-850714637dfb None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:32.656906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7f197-dff6-42ec-a6de-850714637dfb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:32.657014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7f197-dff6-42ec-a6de-850714637dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:32.676845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-77c7f197-dff6-42ec-a6de-850714637dfb None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:32.678071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-77c7f197-dff6-42ec-a6de-850714637dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:32.686483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:32.841846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c7f2-e0b6-4c04-a721-e6a987a5393f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:32.857312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4c7f2-e0b6-4c04-a721-e6a987a5393f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:32.862694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c15d8-f9b9-45d8-94e7-f966cca55aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:32.863332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c15d8-f9b9-45d8-94e7-f966cca55aaf service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:32.863623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c15d8-f9b9-45d8-94e7-f966cca55aaf service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:32.863938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c15d8-f9b9-45d8-94e7-f966cca55aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:32.872265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c15d8-f9b9-45d8-94e7-f966cca55aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:32.873902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c15d8-f9b9-45d8-94e7-f966cca55aaf service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:32.883238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 767/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:33.435852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564546-83a0-4721-ab0a-9bf80ac4b93a None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.436168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564546-83a0-4721-ab0a-9bf80ac4b93a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.436451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564546-83a0-4721-ab0a-9bf80ac4b93a None None] PATH_INFO: `/v3` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.437766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 750/1517] 10.222.0.49 () {54 vars in 925 bytes} [Thu Jun 16 00:25:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:33.445374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549476f3-8416-46b9-83b9-1cf956e85633 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.445670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549476f3-8416-46b9-83b9-1cf956e85633 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.445958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549476f3-8416-46b9-83b9-1cf956e85633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.464775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-549476f3-8416-46b9-83b9-1cf956e85633 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:33.465962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-549476f3-8416-46b9-83b9-1cf956e85633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:33.529699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 768/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jun 16 00:25:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:42.596974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed4bb-1514-49b0-9c5a-b93a69e0276d None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.597511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed4bb-1514-49b0-9c5a-b93a69e0276d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.597511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed4bb-1514-49b0-9c5a-b93a69e0276d None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.598824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 751/1519] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 16 00:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:42.605005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b451d-9c1c-4aa3-9518-bf0640517c87 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.605436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b451d-9c1c-4aa3-9518-bf0640517c87 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.605566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b451d-9c1c-4aa3-9518-bf0640517c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.623408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-5c4b451d-9c1c-4aa3-9518-bf0640517c87 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:42.624624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5c4b451d-9c1c-4aa3-9518-bf0640517c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.633157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 769/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:42.640685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed4bb-1514-49b0-9c5a-b93a69e0276d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.654394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed4bb-1514-49b0-9c5a-b93a69e0276d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.659317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c69af-783c-4d0c-afe9-075135e5a878 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.659974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c69af-783c-4d0c-afe9-075135e5a878 service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.660267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c69af-783c-4d0c-afe9-075135e5a878 service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.660546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c69af-783c-4d0c-afe9-075135e5a878 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.669524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c69af-783c-4d0c-afe9-075135e5a878 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.671117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c69af-783c-4d0c-afe9-075135e5a878 service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.680570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 752/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:44.189262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8be2fb-834f-4fc7-8da3-5dcbc8c834fb None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.189822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8be2fb-834f-4fc7-8da3-5dcbc8c834fb None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.189822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8be2fb-834f-4fc7-8da3-5dcbc8c834fb None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.191199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:44.196175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6c2d-7615-413c-b7cd-f7beacd764fd None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.196625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6c2d-7615-413c-b7cd-f7beacd764fd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.196731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6c2d-7615-413c-b7cd-f7beacd764fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.214726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0c3e6c2d-7615-413c-b7cd-f7beacd764fd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:44.215939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0c3e6c2d-7615-413c-b7cd-f7beacd764fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:44.223826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:44.382837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8be2fb-834f-4fc7-8da3-5dcbc8c834fb None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.397630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8be2fb-834f-4fc7-8da3-5dcbc8c834fb None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.403604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aa02d-3e59-4bd6-beb9-572d85d23d36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.404278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aa02d-3e59-4bd6-beb9-572d85d23d36 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.404566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aa02d-3e59-4bd6-beb9-572d85d23d36 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.404847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aa02d-3e59-4bd6-beb9-572d85d23d36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.413056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aa02d-3e59-4bd6-beb9-572d85d23d36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.415038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aa02d-3e59-4bd6-beb9-572d85d23d36 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.425525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 771/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:45.301077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2e1a-c186-4289-ac31-e4b414647f45 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.301539 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2e1a-c186-4289-ac31-e4b414647f45 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.301644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2e1a-c186-4289-ac31-e4b414647f45 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.302980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:45.307844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca79ce-232c-4477-8282-911f2a7b5e00 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.308281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca79ce-232c-4477-8282-911f2a7b5e00 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.308429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca79ce-232c-4477-8282-911f2a7b5e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.327483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ecca79ce-232c-4477-8282-911f2a7b5e00 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:45.328695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ecca79ce-232c-4477-8282-911f2a7b5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:45.336433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:45.488149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2e1a-c186-4289-ac31-e4b414647f45 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.502731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2e1a-c186-4289-ac31-e4b414647f45 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.508089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f735223-683b-4f50-810e-8903a830b34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.508719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f735223-683b-4f50-810e-8903a830b34e service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.509022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f735223-683b-4f50-810e-8903a830b34e service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.509898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f735223-683b-4f50-810e-8903a830b34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.518207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f735223-683b-4f50-810e-8903a830b34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.519780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f735223-683b-4f50-810e-8903a830b34e service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.529252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 755/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:49.867198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdf302-cb89-4e42-82d4-46d09ff1efd3 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.867768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdf302-cb89-4e42-82d4-46d09ff1efd3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.867768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdf302-cb89-4e42-82d4-46d09ff1efd3 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.869846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:49.874969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716844-97bb-4b8d-8d81-07c100043a25 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.875688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716844-97bb-4b8d-8d81-07c100043a25 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.875688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716844-97bb-4b8d-8d81-07c100043a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.893896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-50716844-97bb-4b8d-8d81-07c100043a25 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:49.895088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-50716844-97bb-4b8d-8d81-07c100043a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.903707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:49.940708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdf302-cb89-4e42-82d4-46d09ff1efd3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.942390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-82bdf302-cb89-4e42-82d4-46d09ff1efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.999977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdf302-cb89-4e42-82d4-46d09ff1efd3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.003477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d217cbd-d327-4a08-b931-6bdb6f4c8cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.004135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d217cbd-d327-4a08-b931-6bdb6f4c8cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.004423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d217cbd-d327-4a08-b931-6bdb6f4c8cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.004704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d217cbd-d327-4a08-b931-6bdb6f4c8cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.013412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d217cbd-d327-4a08-b931-6bdb6f4c8cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.014836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d217cbd-d327-4a08-b931-6bdb6f4c8cb0 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.019671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:50.025476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 774/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:52.139197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581ea4-4e84-4d15-863a-2e5e34e86484 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.139781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581ea4-4e84-4d15-863a-2e5e34e86484 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.139781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581ea4-4e84-4d15-863a-2e5e34e86484 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.141198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:52.146369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3fddd-5135-4930-a8c8-4ab1b9b82c72 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.146798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3fddd-5135-4930-a8c8-4ab1b9b82c72 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.146962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3fddd-5135-4930-a8c8-4ab1b9b82c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.166072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-bac3fddd-5135-4930-a8c8-4ab1b9b82c72 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:52.167255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bac3fddd-5135-4930-a8c8-4ab1b9b82c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.174942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:52.210027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581ea4-4e84-4d15-863a-2e5e34e86484 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.221755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581ea4-4e84-4d15-863a-2e5e34e86484 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.225294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e47ae-0b8b-4822-9b2b-5ad8e9378f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.225958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e47ae-0b8b-4822-9b2b-5ad8e9378f24 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.226245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e47ae-0b8b-4822-9b2b-5ad8e9378f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.226526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e47ae-0b8b-4822-9b2b-5ad8e9378f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.236729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e47ae-0b8b-4822-9b2b-5ad8e9378f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.238141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e47ae-0b8b-4822-9b2b-5ad8e9378f24 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.248106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 758/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:56.119546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b992aa-2633-4ef1-8452-32b8b3108969 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.120147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b992aa-2633-4ef1-8452-32b8b3108969 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.120147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b992aa-2633-4ef1-8452-32b8b3108969 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.121470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:56.126764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2459961-9a4b-458c-bee9-d0af13eaae41 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.127195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2459961-9a4b-458c-bee9-d0af13eaae41 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.127341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2459961-9a4b-458c-bee9-d0af13eaae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.145253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f2459961-9a4b-458c-bee9-d0af13eaae41 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:56.146462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f2459961-9a4b-458c-bee9-d0af13eaae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.154813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:56.420485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b992aa-2633-4ef1-8452-32b8b3108969 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.422173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f8b992aa-2633-4ef1-8452-32b8b3108969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.480342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b992aa-2633-4ef1-8452-32b8b3108969 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.483859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0409d-8d1f-44d4-abb1-cd438a641695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.484528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0409d-8d1f-44d4-abb1-cd438a641695 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.484819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0409d-8d1f-44d4-abb1-cd438a641695 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.485102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0409d-8d1f-44d4-abb1-cd438a641695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.494033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0409d-8d1f-44d4-abb1-cd438a641695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.495473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0409d-8d1f-44d4-abb1-cd438a641695 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.504981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 777/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:58.665683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120716c0-e32f-4bee-8c80-ccaf31ed35fa None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:58.668787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120716c0-e32f-4bee-8c80-ccaf31ed35fa None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:58.669080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120716c0-e32f-4bee-8c80-ccaf31ed35fa None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:58.670488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:25:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:58.675897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676308-7874-4969-a01f-4decbcb6d388 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:58.676305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676308-7874-4969-a01f-4decbcb6d388 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:58.676498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676308-7874-4969-a01f-4decbcb6d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:58.694945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-aa676308-7874-4969-a01f-4decbcb6d388 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:58.696188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-aa676308-7874-4969-a01f-4decbcb6d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:58.704790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:58.997850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120716c0-e32f-4bee-8c80-ccaf31ed35fa None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:58.999519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-120716c0-e32f-4bee-8c80-ccaf31ed35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.007295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=65 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:59.013907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120716c0-e32f-4bee-8c80-ccaf31ed35fa None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.017763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726fa34-15ed-4477-ba9a-b0293ea733b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.018508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726fa34-15ed-4477-ba9a-b0293ea733b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.018793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726fa34-15ed-4477-ba9a-b0293ea733b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.019164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726fa34-15ed-4477-ba9a-b0293ea733b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.030435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726fa34-15ed-4477-ba9a-b0293ea733b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.031864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726fa34-15ed-4477-ba9a-b0293ea733b3 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.045563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 761/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:08.689721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=32 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:09.037445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:38.231991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.232627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.232627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.256837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.258082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.270217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 779/1540] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.280640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.282848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.282848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.308741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.310107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.325005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 762/1541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.329297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.343909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d871-8e7b-46c9-b19b-542ce1b7e3d6 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.348622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.349292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.349581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.350390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.351128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:38.351443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.353241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aecc4-45ed-4226-994b-db3d7e69ca9a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.370753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 780/1542] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:38.378794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.379372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0693de-643a-41ab-855f-ffa54d2f1b88 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.379664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0693de-643a-41ab-855f-ffa54d2f1b88 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.379966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0693de-643a-41ab-855f-ffa54d2f1b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.392340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13c8f-a74d-4e1e-9f75-700fb6710b3c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.404222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.404222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.404222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.404222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.404680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.404929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-be0693de-643a-41ab-855f-ffa54d2f1b88 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.406009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-be0693de-643a-41ab-855f-ffa54d2f1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.406139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.424546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 781/1543] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.436172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba08c91-d7e4-46b3-8603-8ca3efb6df33 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.436504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba08c91-d7e4-46b3-8603-8ca3efb6df33 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.436786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba08c91-d7e4-46b3-8603-8ca3efb6df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.454116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 763/1544] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:38.461572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7ba08c91-d7e4-46b3-8603-8ca3efb6df33 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.462869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7ba08c91-d7e4-46b3-8603-8ca3efb6df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.468030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.588990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 782/1545] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.590099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd4e30-148d-403b-8003-bc8b83067c5d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.590415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.590709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.591113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.612761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.614071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.614071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.614333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.616403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.616403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:38.616403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:27:38.616403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:27:38.617800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffed72-bb3d-47d8-9e93-0ad51b506366 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.627087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.630943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.642269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 783/1546] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.643141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.654935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 764/1547] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:38.657950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00ece9-e9dd-46a5-9503-942967631d83 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.658584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.658888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.659230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.668273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.668965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.669251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.669530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.670270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:38.670579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.672288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.690580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.691928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.695540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 784/1548] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:38.696456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.705635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 765/1549] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:38.706603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.708939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a804c5-c029-4638-be9e-0ec25c289e4c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.717315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a9fe-d0ca-446d-8543-ce21d9082ede None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.720525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25efb-82f4-4151-8cd6-71e210d1ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.721623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25efb-82f4-4151-8cd6-71e210d1ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.721911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25efb-82f4-4151-8cd6-71e210d1ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.722192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25efb-82f4-4151-8cd6-71e210d1ba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.722319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.722985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.723120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25efb-82f4-4151-8cd6-71e210d1ba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.723293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.723557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.724427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.725096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25efb-82f4-4151-8cd6-71e210d1ba4e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.726393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.736985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 785/1550] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:38.738296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.738591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.738871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.762523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 766/1551] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:38.763523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.777076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.778287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.837332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fff78-bcb3-4a6b-9ad8-3544ca3f51c9 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.843412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.844075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.844372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.844658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.845758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:38.846083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.847406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:38.847406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:27:38.847406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:27:38.848410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.863772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 767/1552] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:38.864962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.871848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 786/1553] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.872698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.877775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc30d8-7ba1-4a4a-95ae-b83bab35a649 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.882992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733150-4794-4f63-9bc2-8523c7643498 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.883666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b1d59-d233-4112-955a-2028c24e0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.884382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1d59-d233-4112-955a-2028c24e0d5d admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.884686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1d59-d233-4112-955a-2028c24e0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.884970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b1d59-d233-4112-955a-2028c24e0d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.885712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1d59-d233-4112-955a-2028c24e0d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.887485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b1d59-d233-4112-955a-2028c24e0d5d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.887672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c51d7a-a118-417e-9042-fdd89d8e0b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.888370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51d7a-a118-417e-9042-fdd89d8e0b90 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.888660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51d7a-a118-417e-9042-fdd89d8e0b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.888943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c51d7a-a118-417e-9042-fdd89d8e0b90 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.889630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c51d7a-a118-417e-9042-fdd89d8e0b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.891551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c51d7a-a118-417e-9042-fdd89d8e0b90 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.899165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 768/1554] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:38.900228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12406-5f59-4c19-b073-616cd82415b1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.900531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12406-5f59-4c19-b073-616cd82415b1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.900817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12406-5f59-4c19-b073-616cd82415b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.920240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 787/1555] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:38.920240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a4d0-44ac-4f73-a9d7-e24b183f141a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.920240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a4d0-44ac-4f73-a9d7-e24b183f141a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.920240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a4d0-44ac-4f73-a9d7-e24b183f141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.920754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-61c12406-5f59-4c19-b073-616cd82415b1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.921057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-61c12406-5f59-4c19-b073-616cd82415b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.930275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 769/1556] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.931520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.931814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.932157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.945433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ece5a4d0-44ac-4f73-a9d7-e24b183f141a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.946873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ece5a4d0-44ac-4f73-a9d7-e24b183f141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.950812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.952069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.954733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 788/1557] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.960887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ab733-db09-4455-859a-dc63208aabf2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.960887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ab733-db09-4455-859a-dc63208aabf2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.960887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ab733-db09-4455-859a-dc63208aabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.966059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 770/1558] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.966865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.971763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:38.977931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12ea6-81c1-406a-8e60-bd3a173dc308 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.978302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c41ab733-db09-4455-859a-dc63208aabf2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:38.979495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c41ab733-db09-4455-859a-dc63208aabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.984236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.984930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.985264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.985509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.986238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.988314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.988442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 789/1559] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:38.993319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.993679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.994057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.013449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.014663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.016863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 771/1560] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.017754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.024436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:39.080823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 790/1561] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.081831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.082726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345b29-f357-449b-b38a-c040019c7148 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.087785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c6b2-66b3-40d5-a7dc-562030c2622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.088851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c6b2-66b3-40d5-a7dc-562030c2622b admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.089146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c6b2-66b3-40d5-a7dc-562030c2622b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.089476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c6b2-66b3-40d5-a7dc-562030c2622b admin admin] PATH_INFO: `/v3/projects/8cb4ff211142451a890bab98424f1765/users/35cb33076e294a898838105fe3e521d5/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.091760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a788c-57c8-43e3-9cb2-9362ca53344a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.096377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f005df8-9dc7-4b18-9e0d-be1e161cbd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.096978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f005df8-9dc7-4b18-9e0d-be1e161cbd00 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.097266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f005df8-9dc7-4b18-9e0d-be1e161cbd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.097546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f005df8-9dc7-4b18-9e0d-be1e161cbd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.098284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f005df8-9dc7-4b18-9e0d-be1e161cbd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.100478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f005df8-9dc7-4b18-9e0d-be1e161cbd00 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.105747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4c6b2-66b3-40d5-a7dc-562030c2622b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb4ff211142451a890bab98424f1765, user_id=35cb33076e294a898838105fe3e521d5, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.108478 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4c6b2-66b3-40d5-a7dc-562030c2622b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.114053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 791/1562] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:39.114053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88976d4b-0a4c-46fd-ae0d-26dc42861050 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.114053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88976d4b-0a4c-46fd-ae0d-26dc42861050 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.114053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88976d4b-0a4c-46fd-ae0d-26dc42861050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.125484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 772/1563] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:39 2022] PUT /identity/v3/projects/8cb4ff211142451a890bab98424f1765/users/35cb33076e294a898838105fe3e521d5/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:39.135780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e8dd0-af78-4d67-8b65-a4301c554758 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.135780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e8dd0-af78-4d67-8b65-a4301c554758 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.135780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e8dd0-af78-4d67-8b65-a4301c554758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.136084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-88976d4b-0a4c-46fd-ae0d-26dc42861050 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.136084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-88976d4b-0a4c-46fd-ae0d-26dc42861050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.146005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-236e8dd0-af78-4d67-8b65-a4301c554758 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.147734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-236e8dd0-af78-4d67-8b65-a4301c554758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.191740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 792/1564] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.193092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.193915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.194280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.213391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.214586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.215748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 773/1565] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.217153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.217454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.217740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.226153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 793/1566] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.227175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.236372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.237554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.238049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1f96b-e110-4fcc-a0e4-42c90b9e3d74 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.242786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.243446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.243738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.244055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.244744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.245565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 774/1567] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.246330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.246726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.255794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008221f1-4605-4f9d-9950-991130d5db72 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.261698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.262306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.262599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.262962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.263864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:39.264292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.265968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225cb2b-3a56-431f-a787-38a5a22c62d2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.268195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 794/1568] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.268870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.278695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 775/1569] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:39.279916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7e06-0de1-4293-8b25-2cbebb2bf86a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.280041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.280526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.280819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.287827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.288918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.289234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.289549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.290323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.292112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.306502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 795/1570] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:39.306502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.310184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] MFA Rules not processed for user `35cb33076e294a898838105fe3e521d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.311412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.314844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7946261-3cbe-4eed-8538-cd6616780fa9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.319436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.320121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.320414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.320705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.321426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:39.321747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.323404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.341031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 796/1571] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:39.341031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.344621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:39.352300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571cb31-a573-45fe-80dc-15af55801523 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.358966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.359618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.359933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.360220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.360943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:39.361256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.362854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.375212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 797/1572] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:39.376030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.382799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 776/1573] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.383742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.393263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e03342-2348-4cbd-b8ca-ee84f38886d1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.394335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dd712-5a6a-4ede-b30a-303a923e722b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.399566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.399736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.400291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.400413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.400559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.400751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.400964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.401081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.401704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:39.401825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:39.402015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.402135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.403610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.403719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.417610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 777/1574] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:39.421264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.422671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 798/1575] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:39.423505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.433857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ce1c6-5bbb-4ae1-ad09-e49515e13e97 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.439361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.440092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.440301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e88ef-a46d-45a5-9ece-498f4916d92e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.440404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.440662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.441659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.443145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.445737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.446393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.446683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.446970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.447665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.448720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:39.448720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:27:39.448720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:27:39.449915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.457617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 778/1576] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:39.457617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.468690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74abb-6464-4542-badb-90507a360a69 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.473369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.474246 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.474537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.475405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] PATH_INFO: `/v3/projects/e1ef57f873ed4f679cf1a685c9a3f1ac/users/91b184e8cd0d4f7fbc5d0e71927ded67/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.480409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 799/1577] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.480409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.486973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:39.497609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ef57f873ed4f679cf1a685c9a3f1ac, user_id=91b184e8cd0d4f7fbc5d0e71927ded67, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.500338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.514637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 779/1578] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:39 2022] PUT /identity/v3/projects/e1ef57f873ed4f679cf1a685c9a3f1ac/users/91b184e8cd0d4f7fbc5d0e71927ded67/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:39.515423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.544140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d3f5-6499-4870-a859-9f979183dfac admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.585327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af96104-f014-43b3-b433-819abf763ad6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.590001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819fc8-9112-4eb1-82cd-8a47b6ebbff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.590670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819fc8-9112-4eb1-82cd-8a47b6ebbff5 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.590970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819fc8-9112-4eb1-82cd-8a47b6ebbff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.591247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819fc8-9112-4eb1-82cd-8a47b6ebbff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.591976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819fc8-9112-4eb1-82cd-8a47b6ebbff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.593925 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819fc8-9112-4eb1-82cd-8a47b6ebbff5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.603372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.604007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.604299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.604579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.605524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.607429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.623213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 780/1579] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.623213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ccd5-535e-4190-82ea-0261be215551 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.623213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ccd5-535e-4190-82ea-0261be215551 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.623213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ccd5-535e-4190-82ea-0261be215551 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.623664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 781/1580] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 00:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:39.624401 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ccd5-535e-4190-82ea-0261be215551 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.636770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 800/1581] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.637677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.695177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ccd5-535e-4190-82ea-0261be215551 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.699994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.700699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.700990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.701275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.701969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.703263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55aba-c335-405a-af90-6439fa100e10 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.703938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.708170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.708904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.709322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.709780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.710451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.712478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.718439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:39.731255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 782/1582] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.732168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.741944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 801/1583] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.743059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.771792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:39.804231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5be06-4feb-413f-93a1-6dfec54afd05 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.809206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33efd30-aa08-4ff6-a413-502a13dd3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.809883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33efd30-aa08-4ff6-a413-502a13dd3323 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.810189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33efd30-aa08-4ff6-a413-502a13dd3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.810456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33efd30-aa08-4ff6-a413-502a13dd3323 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.811107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44c307-8474-457e-b2a2-5facc1951cd1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.811222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33efd30-aa08-4ff6-a413-502a13dd3323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.812880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33efd30-aa08-4ff6-a413-502a13dd3323 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.815677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.816377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.816668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.816954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.817639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.820327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.822999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 783/1584] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:39.825051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.825421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.825779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.845678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 802/1585] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.845678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.855231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9298f1-d781-4c21-beba-31936fba552a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.855734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] MFA Rules not processed for user `91b184e8cd0d4f7fbc5d0e71927ded67`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.857009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.859912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7434-711c-4223-8603-eb185c137a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.860608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7434-711c-4223-8603-eb185c137a79 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.860937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7434-711c-4223-8603-eb185c137a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.861224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7434-711c-4223-8603-eb185c137a79 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.861966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7434-711c-4223-8603-eb185c137a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.863903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7434-711c-4223-8603-eb185c137a79 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.887919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 803/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.892198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.892493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.892778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.910245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:39.911468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:39.925232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 784/1587] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.926142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.938506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe59eae-4faa-4dab-b381-b3eba5a16bcc None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.943026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.944363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.944657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.944939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.945626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.947597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:39.967629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 785/1588] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:39.968885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.980420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c7c5-560e-47ef-98a4-d77ed3cc97cd admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:39.985841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:39.986623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:39.986906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:39.987468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:39.987586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 804/1589] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:39.988202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:39.988682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:39.991008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.002727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048723-1f0f-4498-81e1-13c0c5490905 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.008906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.009754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.010146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.010534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.011360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.012694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 786/1590] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:40.015801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.015951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.024663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab19e-9b32-4d5a-861d-1a02830271bb admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.030887 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.031763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.032087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.032374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] PATH_INFO: `/v3/projects/f22e1013157f466ca9918c60bd487215/users/8c430b7562fc4462800e35e85cf53e7b/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.036072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 805/1591] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:39 2022] POST /identity/v3/users => generated 278 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:40.036996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.049362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3f7a8-aa87-4b1b-bf66-eadf29d38f7e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.050336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22e1013157f466ca9918c60bd487215, user_id=8c430b7562fc4462800e35e85cf53e7b, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.053733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.055582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.056484 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.056772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.057457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.058453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.060362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.070905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 787/1592] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/f22e1013157f466ca9918c60bd487215/users/8c430b7562fc4462800e35e85cf53e7b/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:40.071996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 806/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.072233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.072564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.087121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c523de9-3c93-4e68-9203-428b17521f21 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.103893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.142827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726944d3-5be1-47a2-a9db-b12b0be356be admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.146978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.147769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.148055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.148321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.148725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.149011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.149292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.150030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.151638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.152143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.153091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.155077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.158840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.166187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 788/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.166187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.174781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6666b10-4ba8-4dcb-b85d-9df09737b6c4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.180032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.180707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.180991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.181279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.181995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.183649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.187389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 807/1595] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:40 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:40.188351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.196855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 789/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.196855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.204515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400da178-e336-4854-bf86-f82422225b27 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.261433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.262107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.262400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.262688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.263419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.265064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.265439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbbfd4-4340-4f4a-ad84-cc301f66343b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.270886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.272219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.272517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.272805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.275742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 790/1597] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.279074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.286104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0d96d-3e66-43c1-8a87-adb964e5d844 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.291776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.292458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.292749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.293057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.293809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.295389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.305689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 791/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.306482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.315623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a9be-825f-410e-acaf-40e1a59435e3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.320252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f747d9d-6eee-4096-b38d-a5e91f0094fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.320884 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747d9d-6eee-4096-b38d-a5e91f0094fb admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.321174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747d9d-6eee-4096-b38d-a5e91f0094fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.321451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f747d9d-6eee-4096-b38d-a5e91f0094fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.322156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f747d9d-6eee-4096-b38d-a5e91f0094fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.323711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f747d9d-6eee-4096-b38d-a5e91f0094fb admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.331841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.333457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.334558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 792/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.337954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.337954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.337954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.343540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 808/1600] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:40.344410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.355546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2e501-a99c-46da-9603-3fabf8c9d714 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.360179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.360838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.361134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.361417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.362142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.363471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] MFA Rules not processed for user `8c430b7562fc4462800e35e85cf53e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:40.363776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.364362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:40.377319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 809/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.377319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.384933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08860-327f-40ec-a70f-5a28498ea033 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.389685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.390421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.390623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.390915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.391600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.393597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.414922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 810/1602] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:40 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:40.415760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.425366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a3096-9613-48b9-965c-1f0bf944bd39 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.430211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.430861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.431152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.431432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.432190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.433783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.444383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 811/1603] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.445025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.447981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 793/1604] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:40.449027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.460924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f85f6-ed5c-4eb3-ae47-36bbcfbad367 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.463322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d628cd-1fb9-4a1c-bcd0-aa4462c150a2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.466077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.466752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.467030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.467307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.467841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.468107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.468537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.468830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.469114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.469819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.469920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.471419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.477911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.482243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 812/1605] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.483892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 794/1606] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.484561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.488748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.496104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed075-97f5-4043-9128-c55cee0e28c1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.499905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011cf5a-de8d-4929-bd3a-d01ca5214603 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.501795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.503144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.503668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.504149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] PATH_INFO: `/v3/projects/9d7a93a65dcf42cb83ce6d5a4233bd4c/users/23f4bd4c685d489dbcec17b69656044e/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.504527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.505397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.505688 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.506481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] PATH_INFO: `/v3/projects/8a8d2fa871344bc5b77821e3d61f6174/users/6033514b052a462faaea2a6fb24c324c/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.521439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7a93a65dcf42cb83ce6d5a4233bd4c, user_id=23f4bd4c685d489dbcec17b69656044e, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.524080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8d2fa871344bc5b77821e3d61f6174, user_id=6033514b052a462faaea2a6fb24c324c, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.525237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.525355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:40.525355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:27:40.525355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:27:40.527985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.540766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 795/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/9d7a93a65dcf42cb83ce6d5a4233bd4c/users/23f4bd4c685d489dbcec17b69656044e/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:40.541783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.543960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 813/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/8a8d2fa871344bc5b77821e3d61f6174/users/6033514b052a462faaea2a6fb24c324c/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:40.545020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.553690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.611257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886353-7b26-442d-bc6c-f7f0b1320dfe admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.614157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01735c2-a47f-40c7-8375-54984f5c9002 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.616290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.616967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.617260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.617537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.618271 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.619024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.619901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.620045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.620241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.620533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] PATH_INFO: `/v3/projects/fd0c87091ca240cea6fb09bf8c6c60ef/users/4d811ae109464ec983d1902839be090a/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.630043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 796/1609] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:40.631415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.636994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0c87091ca240cea6fb09bf8c6c60ef, user_id=4d811ae109464ec983d1902839be090a, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.639808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.655094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 814/1610] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/fd0c87091ca240cea6fb09bf8c6c60ef/users/4d811ae109464ec983d1902839be090a/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:40.656139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.690912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef8172-cc2a-46e2-baef-61c212ef85c4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.719671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e5432-da78-4c32-8f8e-3598568f613d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.724498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.725929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.726212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.726491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] PATH_INFO: `/v3/projects/f9292660d01b4f72b71e7487cddc0ba8/users/cda9c69ed6594c0a8a95a945dff57fba/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.740947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f3689-5208-4b71-9bdc-1a64dd5108fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.741617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9292660d01b4f72b71e7487cddc0ba8, user_id=cda9c69ed6594c0a8a95a945dff57fba, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.741753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f3689-5208-4b71-9bdc-1a64dd5108fd service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.741961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f3689-5208-4b71-9bdc-1a64dd5108fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.742234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f3689-5208-4b71-9bdc-1a64dd5108fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.744327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.758840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 815/1611] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/f9292660d01b4f72b71e7487cddc0ba8/users/cda9c69ed6594c0a8a95a945dff57fba/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:40.759622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.789023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.808124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f3689-5208-4b71-9bdc-1a64dd5108fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.809669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f3689-5208-4b71-9bdc-1a64dd5108fd service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.819464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 797/1612] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:40.820991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d56bd-dc6b-4854-b5f0-9e7e9f416115 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.821289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d56bd-dc6b-4854-b5f0-9e7e9f416115 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.821580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d56bd-dc6b-4854-b5f0-9e7e9f416115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.823932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6af4e-e530-4010-a010-7d059c8ca29a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.828774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3709cf-a1ac-46af-ab0f-0d6077a6aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.829741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3709cf-a1ac-46af-ab0f-0d6077a6aaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.830099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3709cf-a1ac-46af-ab0f-0d6077a6aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.830454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3709cf-a1ac-46af-ab0f-0d6077a6aaa4 admin admin] PATH_INFO: `/v3/projects/57deb4116e9e4b7798c29c02b38e1d5f/users/c6eede76b9cc4bfcbcecd22f04210b5c/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.840889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b48d56bd-dc6b-4854-b5f0-9e7e9f416115 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:40.842276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b48d56bd-dc6b-4854-b5f0-9e7e9f416115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:40.846949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3709cf-a1ac-46af-ab0f-0d6077a6aaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57deb4116e9e4b7798c29c02b38e1d5f, user_id=c6eede76b9cc4bfcbcecd22f04210b5c, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.850340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3709cf-a1ac-46af-ab0f-0d6077a6aaa4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.851833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 798/1613] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:40.853209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9630-3f77-444b-ae14-45223dea5344 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.853575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9630-3f77-444b-ae14-45223dea5344 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.853933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9630-3f77-444b-ae14-45223dea5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.856499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.870535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 816/1614] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/57deb4116e9e4b7798c29c02b38e1d5f/users/c6eede76b9cc4bfcbcecd22f04210b5c/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:40.872290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e20de-e2ae-4b3c-8e59-ab55289649be None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.873025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e20de-e2ae-4b3c-8e59-ab55289649be None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.873457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e20de-e2ae-4b3c-8e59-ab55289649be None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.875062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 817/1615] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 00:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:40.881818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e20de-e2ae-4b3c-8e59-ab55289649be None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.886859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ee8c9630-3f77-444b-ae14-45223dea5344 None None] MFA Rules not processed for user `6033514b052a462faaea2a6fb24c324c`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:40.888295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ee8c9630-3f77-444b-ae14-45223dea5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:40.952285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e20de-e2ae-4b3c-8e59-ab55289649be None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.958414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c033b9-effc-4a3b-a4e5-87dafd8576c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.959907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 799/1616] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:40.960053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c033b9-effc-4a3b-a4e5-87dafd8576c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.960149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c033b9-effc-4a3b-a4e5-87dafd8576c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.960420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c033b9-effc-4a3b-a4e5-87dafd8576c7 admin admin] PATH_INFO: `/v3/projects/b4386f78e686414c852c8fa8a1f5ac4c/users/c29f3b8b00b340a6ae3a9b33fcaf2a38/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.966215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.966505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.966966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.981353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c033b9-effc-4a3b-a4e5-87dafd8576c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4386f78e686414c852c8fa8a1f5ac4c, user_id=c29f3b8b00b340a6ae3a9b33fcaf2a38, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.984324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c033b9-effc-4a3b-a4e5-87dafd8576c7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:40.997041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:40.999096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.004421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 818/1617] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:40 2022] PUT /identity/v3/projects/b4386f78e686414c852c8fa8a1f5ac4c/users/c29f3b8b00b340a6ae3a9b33fcaf2a38/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:41.008189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bded92-53e7-4d05-a4e3-f1ef793a91ea None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.008619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bded92-53e7-4d05-a4e3-f1ef793a91ea None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.008838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bded92-53e7-4d05-a4e3-f1ef793a91ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.027313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d5bded92-53e7-4d05-a4e3-f1ef793a91ea None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.028863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d5bded92-53e7-4d05-a4e3-f1ef793a91ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.077983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 800/1618] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.079114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.107578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 819/1619] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.109020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaed09-fdee-42b3-9799-fd4bfc664ca0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.109315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaed09-fdee-42b3-9799-fd4bfc664ca0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.109600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaed09-fdee-42b3-9799-fd4bfc664ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.130125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-32eaed09-fdee-42b3-9799-fd4bfc664ca0 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.131233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-32eaed09-fdee-42b3-9799-fd4bfc664ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.147654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e25b-f75e-452d-a3e2-198ed60ddfac None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.152066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630da7ba-1111-4900-9912-bba96d3eb5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.152732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630da7ba-1111-4900-9912-bba96d3eb5fe service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.153026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630da7ba-1111-4900-9912-bba96d3eb5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.153308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630da7ba-1111-4900-9912-bba96d3eb5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.164320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630da7ba-1111-4900-9912-bba96d3eb5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.166030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630da7ba-1111-4900-9912-bba96d3eb5fe service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.180063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 801/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.182472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.183016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.183900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.212129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.213061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 820/1621] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.215667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da637-d813-49ec-b01f-131a012e5d30 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.217500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da637-d813-49ec-b01f-131a012e5d30 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.217986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33da637-d813-49ec-b01f-131a012e5d30 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.220388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 821/1622] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 16 00:27:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:41.226780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] MFA Rules not processed for user `c6eede76b9cc4bfcbcecd22f04210b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.228545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da637-d813-49ec-b01f-131a012e5d30 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.228751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.248037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33da637-d813-49ec-b01f-131a012e5d30 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.255187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.256675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.257451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.257880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.259016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.260991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.270811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.278377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 822/1623] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:41.282475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.296850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673418-007d-47af-b35a-288e9db2601d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.301782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.302781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.303280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.303698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.315068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.316716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.320211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 802/1624] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.324913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.332721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 823/1625] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.334486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.339547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf48420-59af-49fb-9e60-43881609b0de None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.343810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdfabd-ae38-45eb-8660-1002edd8501f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.344662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdfabd-ae38-45eb-8660-1002edd8501f service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.344962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdfabd-ae38-45eb-8660-1002edd8501f service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.345247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdfabd-ae38-45eb-8660-1002edd8501f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.371095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdfabd-ae38-45eb-8660-1002edd8501f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.372852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdfabd-ae38-45eb-8660-1002edd8501f service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.385090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 803/1626] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.386748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.387268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.387479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.420656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.423698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.447648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 804/1627] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.448565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.453318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678531f-48ec-4f4d-a481-c2eb218e287f service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.460162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.461464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98497f9d-a62c-4af8-9961-eb64c0fcf4f2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.461998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.462594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.463176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.469210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.481455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.481603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.482988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.483846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.484397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] PATH_INFO: `/v3/projects/b4386f78e686414c852c8fa8a1f5ac4c/users/c29f3b8b00b340a6ae3a9b33fcaf2a38/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.491343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4386f78e686414c852c8fa8a1f5ac4c, user_id=c29f3b8b00b340a6ae3a9b33fcaf2a38, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.495947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.500791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 824/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.502568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.517351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3bd7-74a7-4c22-bd42-1ba1bb0ec55a service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.524219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b32d14-0dcc-4f58-a38c-28e40a99c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.524899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32d14-0dcc-4f58-a38c-28e40a99c8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.525571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32d14-0dcc-4f58-a38c-28e40a99c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.525867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32d14-0dcc-4f58-a38c-28e40a99c8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.526744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32d14-0dcc-4f58-a38c-28e40a99c8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.529503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32d14-0dcc-4f58-a38c-28e40a99c8f0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.531338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 805/1629] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:41 2022] PUT /identity/v3/projects/b4386f78e686414c852c8fa8a1f5ac4c/users/c29f3b8b00b340a6ae3a9b33fcaf2a38/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:41.532799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.611125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 825/1630] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:41.612885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.617195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.617811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.679797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50d98-33f7-4c3d-8a5b-8baeaebc194b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.681607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] MFA Rules not processed for user `c29f3b8b00b340a6ae3a9b33fcaf2a38`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.683356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.805181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.825801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.826486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.826827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.827112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.828344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 826/1631] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.829623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.930168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.940804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.943160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.955694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85ad20-d19a-4d6e-bf22-5e80c921535d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.964590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.965927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.966500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.966842 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.967647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.970327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.973601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 806/1632] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.974790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.007739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 827/1633] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:42.013320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.034257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d113a4-8ff6-4ee2-b9d6-ea79e9e57eb7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.059391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.062435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.063061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.063361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.064489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.073102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.106912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb095230-1b2b-4519-a77f-bf181edac5b7 service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.112871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 828/1634] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:42.114090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.117068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.117799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.118127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.118414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.138794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089e511-4914-43cc-9449-d18e2533f724 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.141374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.142874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.145280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.148469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.148777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.149231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] PATH_INFO: `/v3/projects/50475f43ea714f0fa6eee6c64c8b015a/users/ea2b8f67a44c4c9f970ed2a5bba182c8/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.178677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 807/1635] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:42.187780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50475f43ea714f0fa6eee6c64c8b015a, user_id=ea2b8f67a44c4c9f970ed2a5bba182c8, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.197570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.230390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 829/1636] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:42 2022] PUT /identity/v3/projects/50475f43ea714f0fa6eee6c64c8b015a/users/ea2b8f67a44c4c9f970ed2a5bba182c8/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:42.234483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.258174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3993-5c27-426b-8948-5823f285796c service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.454879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6251b-4b51-4e76-83ef-94d373bb9503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.455575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6251b-4b51-4e76-83ef-94d373bb9503 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.455890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6251b-4b51-4e76-83ef-94d373bb9503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.456180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6251b-4b51-4e76-83ef-94d373bb9503 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.461225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6251b-4b51-4e76-83ef-94d373bb9503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.465255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6251b-4b51-4e76-83ef-94d373bb9503 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.508567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 808/1637] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:42.509993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.528321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451895-de87-4c73-81a1-38a69c25bed3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.546423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.547354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.547644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.547953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] PATH_INFO: `/v3/projects/50475f43ea714f0fa6eee6c64c8b015a/users/ea2b8f67a44c4c9f970ed2a5bba182c8/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.555573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50475f43ea714f0fa6eee6c64c8b015a, user_id=ea2b8f67a44c4c9f970ed2a5bba182c8, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.558514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.606375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 830/1638] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:42 2022] PUT /identity/v3/projects/50475f43ea714f0fa6eee6c64c8b015a/users/ea2b8f67a44c4c9f970ed2a5bba182c8/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:42.608221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4031-03f6-4a92-b669-792a528f0ad9 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.608709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4031-03f6-4a92-b669-792a528f0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.609188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4031-03f6-4a92-b669-792a528f0ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.634946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.672947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6f9b4031-03f6-4a92-b669-792a528f0ad9 None None] MFA Rules not processed for user `ea2b8f67a44c4c9f970ed2a5bba182c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:42.681927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6f9b4031-03f6-4a92-b669-792a528f0ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:42.737745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cf755-4d9e-4343-905f-c4ab2d43d5d3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.743176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:42.758852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168368c-57d9-4895-ac08-6e9ce82734d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.759540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168368c-57d9-4895-ac08-6e9ce82734d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.760151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168368c-57d9-4895-ac08-6e9ce82734d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.760473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168368c-57d9-4895-ac08-6e9ce82734d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.797335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 809/1639] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:42.805637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7068df-d368-4f71-8868-1eb61cef4e51 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.806074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7068df-d368-4f71-8868-1eb61cef4e51 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.806579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7068df-d368-4f71-8868-1eb61cef4e51 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.822638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 810/1640] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 00:27:42 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:42.823998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7068df-d368-4f71-8868-1eb61cef4e51 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.828117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168368c-57d9-4895-ac08-6e9ce82734d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.829980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168368c-57d9-4895-ac08-6e9ce82734d5 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.842356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 831/1641] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:42.843862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.845126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.845366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.846427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7068df-d368-4f71-8868-1eb61cef4e51 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.852720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.853532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.853765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.853965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.879429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.882371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.890420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:42.893442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:42.896067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 811/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:42.985554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:43.055829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 832/1643] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:43.227052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.251100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55093a-35e7-4b7e-b4c7-570a0bcebc21 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.255829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.256267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.256658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.257153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.271910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.274199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.291033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 812/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:43.350593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.375314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f9557-315a-4ecd-83e7-c1748d4bc1b2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.392028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1623f7e-aede-4658-b5e5-5602a78c0565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.392768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623f7e-aede-4658-b5e5-5602a78c0565 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.393072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623f7e-aede-4658-b5e5-5602a78c0565 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.393388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1623f7e-aede-4658-b5e5-5602a78c0565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.534610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1623f7e-aede-4658-b5e5-5602a78c0565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.534610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1623f7e-aede-4658-b5e5-5602a78c0565 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.562335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 833/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:43 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:43.830673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.956451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432124f-5707-4286-a0ef-b3ff73cd3cf0 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.962343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.963299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.963653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.964036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] PATH_INFO: `/v3/users/6033514b052a462faaea2a6fb24c324c` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.965443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6033514b052a462faaea2a6fb24c324c)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.967731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.055920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6033514b052a462faaea2a6fb24c324c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.067769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6033514b052a462faaea2a6fb24c324c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.087748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6033514b052a462faaea2a6fb24c324c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.092960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6033514b052a462faaea2a6fb24c324c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.093911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6033514b052a462faaea2a6fb24c324c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.130048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 813/1646] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:43 2022] DELETE /identity/v3/users/6033514b052a462faaea2a6fb24c324c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:44.132526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.132929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.133296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.157193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:44.159923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.278355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 834/1647] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:44.305934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:44.312931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.349145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:44.418555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279ba34-7848-4482-8b21-6302209f42ec admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:44.432797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9483-c7f6-493c-a00d-9f625d0b95c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:44.433879 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9483-c7f6-493c-a00d-9f625d0b95c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.434338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9483-c7f6-493c-a00d-9f625d0b95c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.434775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9483-c7f6-493c-a00d-9f625d0b95c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.455073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9483-c7f6-493c-a00d-9f625d0b95c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:44.457897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9483-c7f6-493c-a00d-9f625d0b95c8 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.483007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 814/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:46.947495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:46.949090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:46.976886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02846c8a-873d-415d-83f1-f78b7f971d4f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:46.988903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:46.989810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:46.990206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:46.990658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] PATH_INFO: `/v3/projects/8a8d2fa871344bc5b77821e3d61f6174` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:46.992621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8d2fa871344bc5b77821e3d61f6174)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:46.994565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.174741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8d2fa871344bc5b77821e3d61f6174', 'request_id': 'req-5057fac8-9607-4c73-acd7-b1d841f74b91'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:47.188477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8d2fa871344bc5b77821e3d61f6174', 'request_id': 'req-5057fac8-9607-4c73-acd7-b1d841f74b91'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:47.212562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8d2fa871344bc5b77821e3d61f6174', 'request_id': 'req-5057fac8-9607-4c73-acd7-b1d841f74b91'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:47.239196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] The token cache is being invalidate because project 8a8d2fa871344bc5b77821e3d61f6174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:47.239490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:47.244111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5057fac8-9607-4c73-acd7-b1d841f74b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:47.246050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 835/1649] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:46 2022] DELETE /identity/v3/projects/8a8d2fa871344bc5b77821e3d61f6174 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:47.252451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.253023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.253023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.300802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:47.302554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.545265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 815/1650] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:47.553309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.554304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.554829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.571499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:47.607675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:47.613886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.639627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 836/1651] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:47.644628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.659360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f51d7a-d87f-43a8-80f7-806a6dcc6cf2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.681006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.682540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.683752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.684328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.685161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:47.685561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.689822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.761764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.763668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 816/1652] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:47.775500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bc7dc-b323-44ab-8386-fcded8571f37 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.788474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.789384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.789744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.790126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.790911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.796400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.885930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.894494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 837/1653] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:47.902947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ff3a7-c9b9-41a5-aec4-34eeb3894207 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:48.060815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:48.061532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:48.061823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:48.063187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:48.063187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:48.064794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:48.186739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:48.189231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 817/1654] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:48.204075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459b390-de96-48de-aaf9-3c18f68bbb35 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:48.216988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:48.218072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:48.218514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:48.218944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:48.219834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:48.230514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:48.264561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 838/1655] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:48.269931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:48.287277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60623118-e641-40b3-80fe-f0b9aaf361b4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:48.294282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4855f1-3511-4618-96a9-eb17125bfb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:48.295280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4855f1-3511-4618-96a9-eb17125bfb03 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:48.295778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4855f1-3511-4618-96a9-eb17125bfb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:48.296320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4855f1-3511-4618-96a9-eb17125bfb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:48.297281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4855f1-3511-4618-96a9-eb17125bfb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:48.299126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4855f1-3511-4618-96a9-eb17125bfb03 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:48.360926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 818/1656] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:48.361363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:48.377871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a90e5-1caa-44ed-bccd-21ca36cbd0a0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:48.392534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:48.394107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:48.394406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:48.394700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] PATH_INFO: `/v3/projects/f95498a2162240a3bdedf05240b3ddc5/users/732997ece7dd4066898c6ce070de76eb/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:48.457554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95498a2162240a3bdedf05240b3ddc5, user_id=732997ece7dd4066898c6ce070de76eb, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:48.462661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:48.560629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 839/1657] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:48 2022] PUT /identity/v3/projects/f95498a2162240a3bdedf05240b3ddc5/users/732997ece7dd4066898c6ce070de76eb/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:48.563909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:48.564336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:48.564530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:48.632574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] MFA Rules not processed for user `732997ece7dd4066898c6ce070de76eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:48.634008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:48.667666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:48.835595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 819/1658] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:48.840670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:48.988106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba40e-0285-44a8-b878-ca48bd39c5d3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:49.004640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:49.007258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:49.018638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:49.019654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.020057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.020445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.022193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:49.025361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:49.032022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58cb80-207d-4a77-aaf4-8e56fd24087b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:49.045697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:49.046696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.047058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.048593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] PATH_INFO: `/v3/users/35cb33076e294a898838105fe3e521d5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.050999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cb33076e294a898838105fe3e521d5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:49.067440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:49.107284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 840/1659] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:48 2022] POST /identity/v3/projects => generated 365 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:49.114619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:49.212238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cb33076e294a898838105fe3e521d5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:49.234513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cb33076e294a898838105fe3e521d5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:49.262303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cb33076e294a898838105fe3e521d5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:49.265556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cb33076e294a898838105fe3e521d5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:49.267851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3e7212d-769d-4721-ac7f-489ae7b4e09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cb33076e294a898838105fe3e521d5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:49.328232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2da03-49dd-4894-888c-11b381cf388d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:49.328711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 820/1660] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:49 2022] DELETE /identity/v3/users/35cb33076e294a898838105fe3e521d5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:49.332803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.333109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.333451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.409426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:49.421595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:49.426341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:49.489888 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:49.491427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.491714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.492648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.493365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:49.499295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:49.544874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 841/1661] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:49 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:49.548885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:49.552099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:49.586947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea978d-2b96-498c-b62b-812ecfa22885 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:49.609375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:49.610121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.610585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.610872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.611626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:49.616752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:49.649800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 842/1662] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:49.654174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:49.665685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 821/1663] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:49.674239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860aca3-2a82-47b7-add2-cd017e778caf admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:49.682593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:49.683505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.683794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.684119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] PATH_INFO: `/v3/projects/cf98dfd42193400c989c871f40d69cdb/users/58a5ad9c1d1b41838665e9d431952902/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.766972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf98dfd42193400c989c871f40d69cdb, user_id=58a5ad9c1d1b41838665e9d431952902, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:49.793718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:49.850012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 843/1664] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:49 2022] PUT /identity/v3/projects/cf98dfd42193400c989c871f40d69cdb/users/58a5ad9c1d1b41838665e9d431952902/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:49.854417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:49.868898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06da4d-7c6a-4638-b045-d51e5fda62a2 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:49.885436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:49.889294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:49.970361 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:50.068351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.068351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.068351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.068351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.068715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.076097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.085674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fbc6e-b3ae-4251-a5b8-4643fab8b69e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.098087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982b1a4-a67e-407c-a289-96f798f8fa71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.101469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b1a4-a67e-407c-a289-96f798f8fa71 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.104302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b1a4-a67e-407c-a289-96f798f8fa71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.105034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b1a4-a67e-407c-a289-96f798f8fa71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.121467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 822/1665] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:50.122603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.147213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982b1a4-a67e-407c-a289-96f798f8fa71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.153996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982b1a4-a67e-407c-a289-96f798f8fa71 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.164324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f7a41-38ff-4ea8-bf6c-fb44095632be admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.180283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f713b2-bf73-4af0-9817-667c7b420bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.195956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f713b2-bf73-4af0-9817-667c7b420bec admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.196508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f713b2-bf73-4af0-9817-667c7b420bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.196893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f713b2-bf73-4af0-9817-667c7b420bec admin admin] PATH_INFO: `/v3/projects/cf98dfd42193400c989c871f40d69cdb/users/58a5ad9c1d1b41838665e9d431952902/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.202682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f713b2-bf73-4af0-9817-667c7b420bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf98dfd42193400c989c871f40d69cdb, user_id=58a5ad9c1d1b41838665e9d431952902, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.203722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 844/1666] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:50.206917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f713b2-bf73-4af0-9817-667c7b420bec admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.248167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 823/1667] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:50 2022] PUT /identity/v3/projects/cf98dfd42193400c989c871f40d69cdb/users/58a5ad9c1d1b41838665e9d431952902/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:50.253737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.254251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.254582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.322250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] MFA Rules not processed for user `58a5ad9c1d1b41838665e9d431952902`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:50.323930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.395847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.397001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.397437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.452596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] MFA Rules not processed for user `23f4bd4c685d489dbcec17b69656044e`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:50.455048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.503074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 845/1668] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:50.516203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.518243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.545151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:50.594848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 824/1669] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:50.621389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.622614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.655203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67e9a-d664-4e55-8804-addd6dbbe61f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.661447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.665990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.667193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.668607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.708071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.723967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.749035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 846/1670] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:50.823291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e7c1-9fe5-4d55-86f5-3f4b9a05441e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.855147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.855915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.857869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.858237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.877974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.879973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.912479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.916158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 825/1671] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:50.945258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f776579-57c3-4834-a77c-fd08cd28b7e9 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.950069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.962762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.963193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.963485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.969749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:51.078644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.080226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b63e4-5326-45f1-8079-9ddfce3a88aa service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.102892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 847/1672] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:51.357299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.359783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:51.487562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:51.570489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb5e52-1b45-4af3-8aa1-843a3e2f9a9c service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.593178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.593874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.594186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.594705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] PATH_INFO: `/v3/projects/8cb4ff211142451a890bab98424f1765` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.595733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb4ff211142451a890bab98424f1765)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.596820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: WARNING py.warnings [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:51.596820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: warnings.warn(msg) Jun 16 00:27:51.596820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: Jun 16 00:27:51.598242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.723749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb4ff211142451a890bab98424f1765', 'request_id': 'req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.740862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb4ff211142451a890bab98424f1765', 'request_id': 'req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.775744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb4ff211142451a890bab98424f1765', 'request_id': 'req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.811222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] The token cache is being invalidate because project 8cb4ff211142451a890bab98424f1765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:51.811722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.816300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0ccbfe0-db6a-4ea8-8004-5ccd5b453925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.825222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 826/1673] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:51 2022] DELETE /identity/v3/projects/8cb4ff211142451a890bab98424f1765 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:51.825559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.826008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.826138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.876997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:51.885547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.084695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 848/1674] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:52.096359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.096685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.097131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.153497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:52.157495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.191356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.193699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 827/1675] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:52.215441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e326b0-d77a-4c66-8527-ca8dbd02c2de None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.235794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.237249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.237960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.237960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.239374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:52.240027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.244708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.281237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.293674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 849/1676] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:27:52.297629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6daa66-0840-43bf-bfe2-d2c79fb29a8c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.305796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.306712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.306860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.307199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.307927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.310038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.375196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 828/1677] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:52.382417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.405591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7181a-a9c5-4d52-ba37-9e6b72fc46cf admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.484084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:52.512264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.513357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.513826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.514302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.515186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.518908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.557165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 850/1678] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:52.558276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.578031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea67e4-30dd-40b7-8f7f-421c2df9fda1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.587312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.588282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.588898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.590255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.592010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.594646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.618401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.631761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 829/1679] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:52.633356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeb01d-74d8-4146-b3bd-50e3a1dd0d1f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.640683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264cb8b-3010-4286-955d-e1179b9f71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.643058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264cb8b-3010-4286-955d-e1179b9f71db admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.643527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264cb8b-3010-4286-955d-e1179b9f71db admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.644055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264cb8b-3010-4286-955d-e1179b9f71db admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.645587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264cb8b-3010-4286-955d-e1179b9f71db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.648229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264cb8b-3010-4286-955d-e1179b9f71db admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.666376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.672017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 851/1680] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:52.680197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600074d-4a1c-43d1-8522-4a3ff920fa77 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.686185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.687107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.687572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.687865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] PATH_INFO: `/v3/projects/a82fc6fe0a3a4f74b1f5ab8357a7d691/users/6a76846026ba49489d749c8b3b605c74/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.707086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82fc6fe0a3a4f74b1f5ab8357a7d691, user_id=6a76846026ba49489d749c8b3b605c74, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.711121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.742160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.742350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 830/1681] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:52 2022] PUT /identity/v3/projects/a82fc6fe0a3a4f74b1f5ab8357a7d691/users/6a76846026ba49489d749c8b3b605c74/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:52.742450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.742735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.766795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:52.768178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.904797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 852/1682] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:52.920006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.921846 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:53.090719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2cbbd-d87a-48ba-a79c-5fad176b7b5e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.096355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d7f5a-a33c-46fa-8ac4-2e38506055fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.097269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7f5a-a33c-46fa-8ac4-2e38506055fc service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.097769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7f5a-a33c-46fa-8ac4-2e38506055fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.098224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7f5a-a33c-46fa-8ac4-2e38506055fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.109682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:53.114510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7f5a-a33c-46fa-8ac4-2e38506055fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.118089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7f5a-a33c-46fa-8ac4-2e38506055fc service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.124642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.127033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:53.138292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 831/1683] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:53.188264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602060d1-7fa7-41fc-ba3a-f474c6ff1c80 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.204636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.210218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.210576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.213440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] PATH_INFO: `/v3/users/8c430b7562fc4462800e35e85cf53e7b` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.218315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c430b7562fc4462800e35e85cf53e7b)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.223314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: WARNING py.warnings [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:53.223314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: warnings.warn(msg) Jun 16 00:27:53.223314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: Jun 16 00:27:53.225354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.437918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c430b7562fc4462800e35e85cf53e7b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:53.456927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c430b7562fc4462800e35e85cf53e7b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:53.477083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c430b7562fc4462800e35e85cf53e7b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:53.480667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c430b7562fc4462800e35e85cf53e7b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:53.481585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c430b7562fc4462800e35e85cf53e7b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:53.589843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 853/1684] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:53 2022] DELETE /identity/v3/users/8c430b7562fc4462800e35e85cf53e7b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:53.594670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300705f-732d-45fd-b16b-2831f553f253 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.595119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300705f-732d-45fd-b16b-2831f553f253 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.595119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300705f-732d-45fd-b16b-2831f553f253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.636416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7300705f-732d-45fd-b16b-2831f553f253 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:53.640796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7300705f-732d-45fd-b16b-2831f553f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:53.849649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 832/1685] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:53.915593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.917369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:54.017568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:54.071227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50bf6d-72b4-4e0a-8ed7-d61918db5ee8 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:54.084652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b756714-7bf5-4b0d-ba0e-5f2228022ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:54.085337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756714-7bf5-4b0d-ba0e-5f2228022ecc service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:54.085628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756714-7bf5-4b0d-ba0e-5f2228022ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:54.085906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756714-7bf5-4b0d-ba0e-5f2228022ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:54.124670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b756714-7bf5-4b0d-ba0e-5f2228022ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:54.126256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b756714-7bf5-4b0d-ba0e-5f2228022ecc service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:54.145099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 854/1686] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:55.118368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.119411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.120008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:55.161211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] MFA Rules not processed for user `23f4bd4c685d489dbcec17b69656044e`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:55.165011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.245372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.246741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.247228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:55.364931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] MFA Rules not processed for user `6a76846026ba49489d749c8b3b605c74`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:55.366716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.433723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 833/1687] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:55.439021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:55.440746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.514820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924fa8-105c-41a8-a4b0-d3711f2b6305 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:55.538897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:55.540202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.540676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.541152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] PATH_INFO: `/v3/users/732997ece7dd4066898c6ce070de76eb` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:55.542842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732997ece7dd4066898c6ce070de76eb)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:55.556534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:55.638333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 855/1688] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:55.650797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:55.653514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.689571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8dac7-87b7-4689-ac65-e5cd80ed413a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:55.698171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732997ece7dd4066898c6ce070de76eb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:55.703892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:55.704321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.704612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.704889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:55.705596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:55.708361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:55.728253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732997ece7dd4066898c6ce070de76eb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:55.740864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732997ece7dd4066898c6ce070de76eb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:55.741812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732997ece7dd4066898c6ce070de76eb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:55.742442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-be3201fe-4f59-4076-8c90-a453f8214e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732997ece7dd4066898c6ce070de76eb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:55.765243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 834/1689] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:55 2022] DELETE /identity/v3/users/732997ece7dd4066898c6ce070de76eb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:55.769745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.770153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.771745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:55.804108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 856/1690] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:55 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:55.805405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:55.807184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.820996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:55.823711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.857680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:55.909869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ec949-00bb-4b74-83ac-1e4c1aaa1d45 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:55.916120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:55.916866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.917165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.917481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:55.918141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:55.920235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:55.955913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 857/1691] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:55 2022] POST /identity/v3/users => generated 308 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:55.958281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:55.960148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 835/1692] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:55.972384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518656-495c-432f-b342-f8ca14dce92d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:55.978849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:55.979675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.995541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:55.999022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:55.999410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.999910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.000752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:56.012836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:56.038030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 858/1693] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:56.039734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:56.068049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74fd0-6da4-4f18-9bcd-2a8b5ef66730 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:56.075750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:56.077767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.079333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.082394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] PATH_INFO: `/v3/projects/d22dbcfb930d40a9b070c1a176f6ce68/users/49be4fa884734627982bf620df0d58af/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.123728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22dbcfb930d40a9b070c1a176f6ce68, user_id=49be4fa884734627982bf620df0d58af, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:56.139601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:56.150736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a473b-bf2c-4d5e-b11a-1fbe8ca20545 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:56.151470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:56.165769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 859/1694] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:56 2022] PUT /identity/v3/projects/d22dbcfb930d40a9b070c1a176f6ce68/users/49be4fa884734627982bf620df0d58af/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:56.168134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:56.282704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2fc7d-f00a-44d7-9efe-4b74e7eb0489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:56.283676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fc7d-f00a-44d7-9efe-4b74e7eb0489 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.284001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fc7d-f00a-44d7-9efe-4b74e7eb0489 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.284289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2fc7d-f00a-44d7-9efe-4b74e7eb0489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.324351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12cd77-f334-4e45-85d9-f757260b83a0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:56.335363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:56.336205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.336546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.336828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.337592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:56.339216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:56.373450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 860/1695] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:56.374360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:56.389354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899c36-b3df-4f82-b8bc-1ef72efbf1a8 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:56.399078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a0311-4b81-41c0-b800-0088ef8ec4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:56.400415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a0311-4b81-41c0-b800-0088ef8ec4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.400893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a0311-4b81-41c0-b800-0088ef8ec4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.401556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a0311-4b81-41c0-b800-0088ef8ec4fc admin admin] PATH_INFO: `/v3/projects/d22dbcfb930d40a9b070c1a176f6ce68/users/49be4fa884734627982bf620df0d58af/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.408293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a0311-4b81-41c0-b800-0088ef8ec4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22dbcfb930d40a9b070c1a176f6ce68, user_id=49be4fa884734627982bf620df0d58af, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:56.412150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a0311-4b81-41c0-b800-0088ef8ec4fc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:56.430304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2fc7d-f00a-44d7-9efe-4b74e7eb0489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:56.431767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2fc7d-f00a-44d7-9efe-4b74e7eb0489 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:56.447581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 861/1696] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:56 2022] PUT /identity/v3/projects/d22dbcfb930d40a9b070c1a176f6ce68/users/49be4fa884734627982bf620df0d58af/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:56.453029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 836/1697] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:56.976425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e56ad-4831-470d-9a6c-f1dd39e88a3e None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.977320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e56ad-4831-470d-9a6c-f1dd39e88a3e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.977320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e56ad-4831-470d-9a6c-f1dd39e88a3e None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.978742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 862/1698] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 00:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:56.985541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.985929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.986261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.041710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:57.051142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] MFA Rules not processed for user `cb15a3e003fb4f0f8f876c5635b6a020`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:57.053757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:57.151341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e56ad-4831-470d-9a6c-f1dd39e88a3e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:57.153171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-747e56ad-4831-470d-9a6c-f1dd39e88a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:57.190617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 837/1699] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:27:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:57.257763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:57.267710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ba08a-5d2f-4def-89b8-bd4658daffff None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:57.273958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a13f3-bab7-4636-bf10-750682cf2e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:57.274749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a13f3-bab7-4636-bf10-750682cf2e62 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:57.274928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a13f3-bab7-4636-bf10-750682cf2e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:57.275399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a13f3-bab7-4636-bf10-750682cf2e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.287096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a13f3-bab7-4636-bf10-750682cf2e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:57.289705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e56ad-4831-470d-9a6c-f1dd39e88a3e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:57.303955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:57.304805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:57.305097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:57.305385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] PATH_INFO: `/v3/projects/f22e1013157f466ca9918c60bd487215` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.306615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22e1013157f466ca9918c60bd487215)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:57.307443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a13f3-bab7-4636-bf10-750682cf2e62 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:57.308934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:57.341386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 838/1700] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:57.402752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22e1013157f466ca9918c60bd487215', 'request_id': 'req-da30f0a8-4e6c-4141-8858-3e5f2da62650'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:57.421886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22e1013157f466ca9918c60bd487215', 'request_id': 'req-da30f0a8-4e6c-4141-8858-3e5f2da62650'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:57.434805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22e1013157f466ca9918c60bd487215', 'request_id': 'req-da30f0a8-4e6c-4141-8858-3e5f2da62650'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:57.452596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] The token cache is being invalidate because project f22e1013157f466ca9918c60bd487215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:57.452881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:57.453743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-da30f0a8-4e6c-4141-8858-3e5f2da62650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:57.457365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 863/1701] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:57 2022] DELETE /identity/v3/projects/f22e1013157f466ca9918c60bd487215 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:57.463124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:57.463496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:57.463854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.510638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:57.513482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:57.669084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 839/1702] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:57.678306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:57.679832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:57.680298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.721714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:57.748197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:57.779489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 864/1703] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:57.783710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:57.801416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e954-2e90-46bc-9fda-4a35a100c24e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:57.817735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:57.820667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:57.820959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:57.821246 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.829408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:57.829749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:57.836106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:57.872168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 840/1704] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:57.872850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:57.879499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:57.894579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf26ace-0092-41a4-9b15-559289214918 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:57.911740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:57.912971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:57.917129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:57.917704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:57.918658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:57.921042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:58.017439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 865/1705] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:57 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:58.023728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:58.039504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5479d0-9176-49fa-9ee8-88c1e7bebf43 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:58.194586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:58.195319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.195753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.196081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.196903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:58.198852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:58.250269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 841/1706] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:58 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:58.251935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:58.267894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687159-ad63-409b-a5e5-817b3b0b8051 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:58.284649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:58.285353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.285705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.285995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.287309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:58.288995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:58.315374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 866/1707] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:58.319753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:58.334778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042048-c16f-45c9-9d99-2ecc7ee45426 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:58.356701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:58.357727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.358193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.358704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.359803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:58.361936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:58.380184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 842/1708] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:58.384788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:58.402493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f999e08-b2f4-447c-9078-ac5258cd6778 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:58.409340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:58.412721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:58.413450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f51f8a-b92f-4c7f-9074-65db52f6fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:58.414371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51f8a-b92f-4c7f-9074-65db52f6fd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.414666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51f8a-b92f-4c7f-9074-65db52f6fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.415009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f51f8a-b92f-4c7f-9074-65db52f6fd59 admin admin] PATH_INFO: `/v3/projects/37c130e4417f445ab54268ade8410abe/users/872152b35b4b49a2a55b4316c971a239/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.434990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77544c-e7a4-4775-acf0-f86a6d43bd58 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:58.446048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:58.447658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.448344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.448768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] PATH_INFO: `/v3/projects/f95498a2162240a3bdedf05240b3ddc5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.449291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f51f8a-b92f-4c7f-9074-65db52f6fd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c130e4417f445ab54268ade8410abe, user_id=872152b35b4b49a2a55b4316c971a239, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:58.450910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95498a2162240a3bdedf05240b3ddc5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:58.452308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f51f8a-b92f-4c7f-9074-65db52f6fd59 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:58.454025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:58.461079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:58.480441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 867/1709] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:58 2022] PUT /identity/v3/projects/37c130e4417f445ab54268ade8410abe/users/872152b35b4b49a2a55b4316c971a239/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:58.506692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c96c0-0b38-41e7-8564-cd6a35df0b01 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.507613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c96c0-0b38-41e7-8564-cd6a35df0b01 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.507613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c96c0-0b38-41e7-8564-cd6a35df0b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.643548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3a7c96c0-0b38-41e7-8564-cd6a35df0b01 None None] MFA Rules not processed for user `872152b35b4b49a2a55b4316c971a239`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:58.648040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95498a2162240a3bdedf05240b3ddc5', 'request_id': 'req-f074dc27-6109-4cc4-b65b-c522ef76aa22'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:58.650387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3a7c96c0-0b38-41e7-8564-cd6a35df0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:58.668680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95498a2162240a3bdedf05240b3ddc5', 'request_id': 'req-f074dc27-6109-4cc4-b65b-c522ef76aa22'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:58.694285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95498a2162240a3bdedf05240b3ddc5', 'request_id': 'req-f074dc27-6109-4cc4-b65b-c522ef76aa22'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:58.730774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] The token cache is being invalidate because project f95498a2162240a3bdedf05240b3ddc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:58.731080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:58.735357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f074dc27-6109-4cc4-b65b-c522ef76aa22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:58.741574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 843/1710] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:58 2022] DELETE /identity/v3/projects/f95498a2162240a3bdedf05240b3ddc5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:58.746649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.746946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.747239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.831454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] MFA Rules not processed for user `4d811ae109464ec983d1902839be090a`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:58.832419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:58.894683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 868/1711] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:58.894683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:58.894683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:58.895277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:58.964079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] MFA Rules not processed for user `cda9c69ed6594c0a8a95a945dff57fba`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:58.965444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.044051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 844/1712] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:59.045120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:59.050476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.161279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 869/1713] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:59.163569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:59.165974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.217382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d081b85-9b69-44a6-a906-8f02ff538375 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:59.232670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:59.234550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:59.234896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:59.235249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] PATH_INFO: `/v3/users/58a5ad9c1d1b41838665e9d431952902` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:59.243221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a5ad9c1d1b41838665e9d431952902)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:59.248615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:59.252552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:59.299696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11795703-656c-4cbb-9b32-0f11e5c459aa None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:59.306051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:59.306762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:59.307157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:59.308016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:59.309120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:59.311602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:59.321610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:59.374647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a5ad9c1d1b41838665e9d431952902'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:59.391915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 870/1714] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:59 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:59.397431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a5ad9c1d1b41838665e9d431952902'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:59.399892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:59.402922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.415071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a5ad9c1d1b41838665e9d431952902'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:59.416905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a5ad9c1d1b41838665e9d431952902'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:59.417960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f3c6c88-3775-4fc8-9c9c-b9eb8dd2e58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a5ad9c1d1b41838665e9d431952902'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:59.450305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 845/1715] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:59 2022] DELETE /identity/v3/users/58a5ad9c1d1b41838665e9d431952902 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:59.451400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291359c5-95af-45ef-94e7-c881e2cdf3c6 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:59.451694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291359c5-95af-45ef-94e7-c881e2cdf3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:59.452004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291359c5-95af-45ef-94e7-c881e2cdf3c6 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:59.465402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 846/1716] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 16 00:27:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:59.468849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f41060-0bed-4e6e-b677-75f347f13d1f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:59.468849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f41060-0bed-4e6e-b677-75f347f13d1f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:59.469312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f41060-0bed-4e6e-b677-75f347f13d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:59.518902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f7f41060-0bed-4e6e-b677-75f347f13d1f None None] MFA Rules not processed for user `49be4fa884734627982bf620df0d58af`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:59.520755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f7f41060-0bed-4e6e-b677-75f347f13d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.585735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909bef6-323d-429f-99cc-6dd2dda4ef54 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:59.680946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 847/1717] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:59.684692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b17a-4a8c-4de4-ab4f-a3d0c4af2a41 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:59.686426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b17a-4a8c-4de4-ab4f-a3d0c4af2a41 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:59.686948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b17a-4a8c-4de4-ab4f-a3d0c4af2a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:59.766614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:59.767585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:59.768015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:59.768440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:59.777771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.797576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-fb20b17a-4a8c-4de4-ab4f-a3d0c4af2a41 None None] MFA Rules not processed for user `cda9c69ed6594c0a8a95a945dff57fba`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:59.798835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-fb20b17a-4a8c-4de4-ab4f-a3d0c4af2a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:59.926873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:59.974611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:59.976490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:00.030873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 871/1718] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:00.033837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:00.044845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:00.117473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 848/1719] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:27:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:00.127751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:00.128082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:00.128698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:00.257725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:00.262948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:00.346602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a2bcb-f9b1-483b-83eb-ab3d25509fd4 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:00.375398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:00.376607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:00.377164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:00.377676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:00.378606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:00.391814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:00.460153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 872/1720] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:00 2022] POST /identity/v3/users => generated 288 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:00.461243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:00.465034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:00.473243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:00.521121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d26db-09f7-475b-87d3-119d9fed7645 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:00.550308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:00.551216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:00.551616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:00.552061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:00.562302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:00.602079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:00.604652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:00.641312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 873/1721] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:00.646591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 849/1722] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 16 00:28:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:00.648646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:00.659309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:00.672086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:00.692354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242601d6-2938-451b-a6b9-a3d62ae4fdea None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:00.709306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:00.711487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:00.712511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:00.712511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:00.713791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:00.718362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:00.785955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 850/1723] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:00.792695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4077f2f-5d50-4f9d-b072-f18aadec2fde service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:00.795814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:00.822246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:00.823149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:00.823437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:00.823719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] PATH_INFO: `/v3/projects/cf98dfd42193400c989c871f40d69cdb` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:00.831988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf98dfd42193400c989c871f40d69cdb)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:00.845944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:00.847681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f85d6-0bf0-43bd-8d38-fe5dc9c084eb admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:00.890545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:00.891216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:00.891505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:00.891787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:00.904922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:01.007509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:01.024374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:01.078402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 851/1724] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:01.078979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf98dfd42193400c989c871f40d69cdb', 'request_id': 'req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:01.081042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:01.101562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf98dfd42193400c989c871f40d69cdb', 'request_id': 'req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:01.122620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f6dd-f73f-43bc-b1a7-90c158d6697e service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:01.124947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf98dfd42193400c989c871f40d69cdb', 'request_id': 'req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:01.171140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] The token cache is being invalidate because project cf98dfd42193400c989c871f40d69cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:01.171317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:01.180943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c79d2bf-c36e-40f2-8fc5-a8e89a88625c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:01.186133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 874/1725] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:00 2022] DELETE /identity/v3/projects/cf98dfd42193400c989c871f40d69cdb => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:01.191604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2600e6-c1d6-49e5-9789-9106373ff1f5 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.191960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2600e6-c1d6-49e5-9789-9106373ff1f5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.192249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2600e6-c1d6-49e5-9789-9106373ff1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.283654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2c2600e6-c1d6-49e5-9789-9106373ff1f5 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:01.291770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2c2600e6-c1d6-49e5-9789-9106373ff1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:01.369464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:01.372442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.372744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.373077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] PATH_INFO: `/v3/projects/c665aafd74dd4de8a3d1364dc35ddda0/users/f6b4ba2f42644b18a9e5e9318b8f63d2/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.414705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c665aafd74dd4de8a3d1364dc35ddda0, user_id=f6b4ba2f42644b18a9e5e9318b8f63d2, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:01.419485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:01.448379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 852/1726] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:01 2022] PUT /identity/v3/projects/c665aafd74dd4de8a3d1364dc35ddda0/users/f6b4ba2f42644b18a9e5e9318b8f63d2/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:01.451794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:01.460368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:01.485987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:01.558045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 875/1727] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:01.559896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.560378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.560841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.584788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:01.586596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:01.681579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdd7d3-7181-4dcf-9a78-e48bca6e6185 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:01.686561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:01.687250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.687541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.687824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.688622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:01.690541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:01.705362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 853/1728] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:01.709506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:01.741707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5f8e7-80cc-44e1-bb61-644d8d4a14a2 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:01.758533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 876/1729] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:01.760310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aa921-3ce3-4602-9ead-5ef14d43510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:01.760707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:01.763675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa921-3ce3-4602-9ead-5ef14d43510b admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.766488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa921-3ce3-4602-9ead-5ef14d43510b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.768593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aa921-3ce3-4602-9ead-5ef14d43510b admin admin] PATH_INFO: `/v3/projects/c665aafd74dd4de8a3d1364dc35ddda0/users/f6b4ba2f42644b18a9e5e9318b8f63d2/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.774998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aa921-3ce3-4602-9ead-5ef14d43510b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c665aafd74dd4de8a3d1364dc35ddda0, user_id=f6b4ba2f42644b18a9e5e9318b8f63d2, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:01.783456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aa921-3ce3-4602-9ead-5ef14d43510b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:01.792930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bdd5b-10e2-4219-9f0d-565e4f4738ad None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:01.815193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:01.815905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.816265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.816617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.817515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:01.818569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:01.820473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:01.836716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 854/1730] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:01 2022] PUT /identity/v3/projects/c665aafd74dd4de8a3d1364dc35ddda0/users/f6b4ba2f42644b18a9e5e9318b8f63d2/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:01.847836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:01.848310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:01.848844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:01.866014 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 877/1731] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:01.867202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:01.882494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db54955-0471-430a-85b1-40f00634ffa2 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:01.898893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:01.938938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] MFA Rules not processed for user `f6b4ba2f42644b18a9e5e9318b8f63d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:01.942690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:02.056240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.056938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.057222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.058083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.058258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.062425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:02.128935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 878/1732] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:02.130259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:02.234331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2e34-074e-4d1d-8378-1f827867023a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:02.240558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.241457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.241750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.242078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.242812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.247413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:02.256879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:02.265659 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 855/1733] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:02.280827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:02.288047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:02.300026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 879/1734] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:02 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:02.301445 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:02.323937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213db80-9034-48c2-9a34-2eeb456c9bfb admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:02.336761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.337773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.339099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.339396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.341417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.347005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:02.363697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 880/1735] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:02.367820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:02.378339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6efd3c-bfdf-4a41-b2a8-f7598a378c5e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:02.384859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.385611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.385814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.386094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.386856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.388530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:02.404292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 881/1736] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:02.405279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:02.415867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19cb57-0535-4e78-8fde-fabdc78270e6 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:02.420892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e94036-c9f5-4fd2-bf5d-416e71c60006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.421778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e94036-c9f5-4fd2-bf5d-416e71c60006 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.422062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e94036-c9f5-4fd2-bf5d-416e71c60006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.422336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e94036-c9f5-4fd2-bf5d-416e71c60006 admin admin] PATH_INFO: `/v3/projects/96808c02d2e64ae19e31bdd5415d50c8/users/07a679aa2f044b8198e1dc3dcd7297c9/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.437890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a1955-ddbe-400e-bd3c-4be5c3d9c491 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:02.440009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e94036-c9f5-4fd2-bf5d-416e71c60006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96808c02d2e64ae19e31bdd5415d50c8, user_id=07a679aa2f044b8198e1dc3dcd7297c9, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.443439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e94036-c9f5-4fd2-bf5d-416e71c60006 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:02.469344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 882/1737] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:02 2022] PUT /identity/v3/projects/96808c02d2e64ae19e31bdd5415d50c8/users/07a679aa2f044b8198e1dc3dcd7297c9/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:02.480063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.480368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.480653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.541133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] MFA Rules not processed for user `07a679aa2f044b8198e1dc3dcd7297c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:02.544880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:02.618584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.620806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.622064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.625683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.785941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 883/1738] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:02.788248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:02.876184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.880765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:02.901536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:02.925451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 856/1739] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:02.965317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cc5f4-e228-4736-96f6-a9542e4dc33c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:02.981822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:02.982916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:02.990032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:02.990343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:02.991793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:02.993209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:03.054955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:03.063683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 884/1740] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:02 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:03.075527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b62de-975a-4aad-80e9-43330f54a0d3 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:03.219843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:03.220574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.220861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.221149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.221910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:03.226966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:03.286056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 857/1741] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:03 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:03.291375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:03.311030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bf718-901b-4b90-afc9-6ca1a787d400 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:03.316556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83672290-704d-4ad0-a525-7b29f8016e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:03.317324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672290-704d-4ad0-a525-7b29f8016e4e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.318241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672290-704d-4ad0-a525-7b29f8016e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.318633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672290-704d-4ad0-a525-7b29f8016e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.319650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83672290-704d-4ad0-a525-7b29f8016e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:03.321440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83672290-704d-4ad0-a525-7b29f8016e4e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:03.340362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:03.340878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 885/1742] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:03.352635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897517b-626e-4555-88a9-603f69f54496 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:03.360223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:03.361552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.363194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.363697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] PATH_INFO: `/v3/projects/6397377faa9b44d5aaf337bd95fa8b33/users/4fa846cf462d45a1962be323aba36516/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.381837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150670d2-73f7-48b5-98f5-5223480fb25b None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.382600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150670d2-73f7-48b5-98f5-5223480fb25b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.383121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150670d2-73f7-48b5-98f5-5223480fb25b None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.385653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 886/1743] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:28:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:28:03.405165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6397377faa9b44d5aaf337bd95fa8b33, user_id=4fa846cf462d45a1962be323aba36516, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:03.409935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:03.428353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee66ed-8458-484a-9045-e897e6fa3d38 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.429088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee66ed-8458-484a-9045-e897e6fa3d38 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.430506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee66ed-8458-484a-9045-e897e6fa3d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.472874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 858/1744] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:03 2022] PUT /identity/v3/projects/6397377faa9b44d5aaf337bd95fa8b33/users/4fa846cf462d45a1962be323aba36516/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:03.477682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:03.480134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:03.505943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a5ee66ed-8458-484a-9045-e897e6fa3d38 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:03.507456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a5ee66ed-8458-484a-9045-e897e6fa3d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:03.661890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faada83e-ad13-4f88-a76b-673a3bca5ff1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:03.674797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:03.675504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.675831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.683037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.683037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:03.686917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:03.690255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 887/1745] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:28:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:03.700874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6dc5-0e40-4d61-b312-ef0d55a399f7 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.714340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6dc5-0e40-4d61-b312-ef0d55a399f7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.714340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc6dc5-0e40-4d61-b312-ef0d55a399f7 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.714340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 888/1746] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 16 00:28:03 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:28:03.730959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7a34-1517-4bf4-b1c8-0bc82c44b17c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.731333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7a34-1517-4bf4-b1c8-0bc82c44b17c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.731632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7a34-1517-4bf4-b1c8-0bc82c44b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.749455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 859/1747] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:03.750392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:03.792479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6787-7cff-4aab-a060-5fe7acda7c26 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:03.797500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-748d7a34-1517-4bf4-b1c8-0bc82c44b17c None None] MFA Rules not processed for user `cb15a3e003fb4f0f8f876c5635b6a020`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:03.798741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-748d7a34-1517-4bf4-b1c8-0bc82c44b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:03.809595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:03.810400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:03.810689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:03.810970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] PATH_INFO: `/v3/projects/6397377faa9b44d5aaf337bd95fa8b33/users/4fa846cf462d45a1962be323aba36516/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:03.816785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6397377faa9b44d5aaf337bd95fa8b33, user_id=4fa846cf462d45a1962be323aba36516, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:03.823320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:03.891444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 860/1748] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:03 2022] PUT /identity/v3/projects/6397377faa9b44d5aaf337bd95fa8b33/users/4fa846cf462d45a1962be323aba36516/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:03.892574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:03.906514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:04.032342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 889/1749] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:28:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:04.035354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:04.035652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:04.037158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:04.080686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:04.093511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] MFA Rules not processed for user `4fa846cf462d45a1962be323aba36516`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:04.094661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:04.148306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714fa4-8bf6-4a87-95b5-c03ece768f0b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:04.161417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:04.164175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:04.164642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:04.165238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:04.195708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:04.201436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:04.253296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 861/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:04.254364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:04.257619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:04.344553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 890/1751] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:04.465801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:04.481763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d7e1-6b91-47ce-8011-cb3155c9b98b service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:04.492907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:04.493841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:04.494137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:04.494584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:04.519685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:04.528383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:04.597444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 862/1752] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:04.598319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:04.641379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3497f-20a5-41e7-bc79-eea02fa492a2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:04.655972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec9ec8-fae9-45d4-874e-155594e271f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:04.659930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9ec8-fae9-45d4-874e-155594e271f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:04.659930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9ec8-fae9-45d4-874e-155594e271f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:04.659930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9ec8-fae9-45d4-874e-155594e271f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:04.683581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec9ec8-fae9-45d4-874e-155594e271f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:04.686523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec9ec8-fae9-45d4-874e-155594e271f2 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:04.715759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 891/1753] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:04.768434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:04.975423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:04.975423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:04.975423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:04.984926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40a66c-e2f5-4b20-a5cd-453baf580f06 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:05.008181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] MFA Rules not processed for user `4d811ae109464ec983d1902839be090a`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:05.009418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.011768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:05.012834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.025189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.025697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] PATH_INFO: `/v3/users/07a679aa2f044b8198e1dc3dcd7297c9` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:05.027607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a679aa2f044b8198e1dc3dcd7297c9)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:05.030203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:05.135725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a679aa2f044b8198e1dc3dcd7297c9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.146832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a679aa2f044b8198e1dc3dcd7297c9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.156142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a679aa2f044b8198e1dc3dcd7297c9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.157623 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a679aa2f044b8198e1dc3dcd7297c9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.158739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b436b899-b640-402a-94ca-34d83a78aedd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a679aa2f044b8198e1dc3dcd7297c9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.179195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 892/1754] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:05.179564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:05.180794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:05.184065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.189391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 863/1755] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:04 2022] DELETE /identity/v3/users/07a679aa2f044b8198e1dc3dcd7297c9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:05.196896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36abd-1fdd-4250-aad3-f696ad718021 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.197219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36abd-1fdd-4250-aad3-f696ad718021 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.197507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36abd-1fdd-4250-aad3-f696ad718021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:05.224638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b0d36abd-1fdd-4250-aad3-f696ad718021 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:05.227223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b0d36abd-1fdd-4250-aad3-f696ad718021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.263295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5646f7c-4056-4574-8c88-556aabcc6f96 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:05.429441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:05.433337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 864/1756] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:05.433502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.433723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.434013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:05.436502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.437266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.439127 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] PATH_INFO: `/v3/users/872152b35b4b49a2a55b4316c971a239` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:05.440806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872152b35b4b49a2a55b4316c971a239)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:05.444973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:05.475341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:05.476813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.540288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872152b35b4b49a2a55b4316c971a239'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.553013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872152b35b4b49a2a55b4316c971a239'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.566989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872152b35b4b49a2a55b4316c971a239'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.578247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872152b35b4b49a2a55b4316c971a239'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.580263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0155ad3-d01f-4999-a6eb-c9786dadcb55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872152b35b4b49a2a55b4316c971a239'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:05.581726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 865/1757] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:05.582589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:05.584513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.617970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 893/1758] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:05 2022] DELETE /identity/v3/users/872152b35b4b49a2a55b4316c971a239 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:05.622553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061a84-e528-49db-859c-20630657c199 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.622992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061a84-e528-49db-859c-20630657c199 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.625007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061a84-e528-49db-859c-20630657c199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:05.643473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:05.674048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-99061a84-e528-49db-859c-20630657c199 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:05.675759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-99061a84-e528-49db-859c-20630657c199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.737748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5bdef-98b5-45da-b9d1-173532a178bd None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:05.780116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 894/1759] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:05.809553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99061a84-e528-49db-859c-20630657c199 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:05.903351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:05.904701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.905907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.907287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:05.912415 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.953770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:05.956100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:05.973278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 866/1760] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:05.975042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:05.976857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:05.984865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:05.986689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99061a84-e528-49db-859c-20630657c199 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:05.997174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fb3a0-8014-48a0-8094-2ff8692451a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:05.997174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fb3a0-8014-48a0-8094-2ff8692451a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:05.997174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fb3a0-8014-48a0-8094-2ff8692451a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:05.997174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fb3a0-8014-48a0-8094-2ff8692451a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.024395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fb3a0-8014-48a0-8094-2ff8692451a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.025945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fb3a0-8014-48a0-8094-2ff8692451a4 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.053374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 895/1761] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:06.054883 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eb9b5-a186-4a0e-8787-9af9ab20cabb None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.055181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eb9b5-a186-4a0e-8787-9af9ab20cabb None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.055470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eb9b5-a186-4a0e-8787-9af9ab20cabb None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.057157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 896/1762] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:28:06.057929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eb9b5-a186-4a0e-8787-9af9ab20cabb None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:06.064771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-458eb9b5-a186-4a0e-8787-9af9ab20cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.098409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eb9b5-a186-4a0e-8787-9af9ab20cabb None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:06.107622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:06.108784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.109336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.109786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] PATH_INFO: `/v3/users/c6eede76b9cc4bfcbcecd22f04210b5c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.111238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6eede76b9cc4bfcbcecd22f04210b5c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.113382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.114932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f330df-2500-4c8a-8dc9-3d1130a6b38e service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:06.122994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:06.124026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.124390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.124903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.191092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6eede76b9cc4bfcbcecd22f04210b5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.205986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6eede76b9cc4bfcbcecd22f04210b5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.222180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6eede76b9cc4bfcbcecd22f04210b5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.223037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6eede76b9cc4bfcbcecd22f04210b5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.223856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b98fefe0-290e-4ae2-9a94-c3e1f676de86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6eede76b9cc4bfcbcecd22f04210b5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.231649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.233932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.245875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 867/1763] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:06.247451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:06.249855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.269681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f852a-4843-4ee2-b4bb-8d77d8006d12 service swift] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:06.276261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 897/1764] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:06 2022] DELETE /identity/v3/users/c6eede76b9cc4bfcbcecd22f04210b5c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:06.284649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f24199-a7fa-445b-be9d-f360f9f41d04 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.285015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f24199-a7fa-445b-be9d-f360f9f41d04 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.285321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f24199-a7fa-445b-be9d-f360f9f41d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.337135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c5f24199-a7fa-445b-be9d-f360f9f41d04 None None] MFA Rules not processed for user `832a04959b5448738fb9d46cf42845a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:06.338404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5f24199-a7fa-445b-be9d-f360f9f41d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.356869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:06.406123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:06.411167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.412692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.413046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] PATH_INFO: `/v3/users/6a76846026ba49489d749c8b3b605c74` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.418668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a76846026ba49489d749c8b3b605c74)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.425053 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.554302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a76846026ba49489d749c8b3b605c74'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.560655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:06.568909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 898/1765] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:28:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:06.572671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.573500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.577936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a76846026ba49489d749c8b3b605c74'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.578221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.602312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a76846026ba49489d749c8b3b605c74'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.603329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a76846026ba49489d749c8b3b605c74'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.605738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a76846026ba49489d749c8b3b605c74'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.658129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:06.659473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.660755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 868/1766] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:06 2022] DELETE /identity/v3/users/6a76846026ba49489d749c8b3b605c74 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:06.663419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:06.667752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.908378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28e57-6613-44d7-ad85-f400807cdfe4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:06.931399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:06.932540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.933788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.934083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.937605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.964763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 899/1767] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:06.990101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.994821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.999355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.000996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:07.037834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 869/1768] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:07.244867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318216d7-b1c4-4209-9c91-369baf044138 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.257244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.258098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.258392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.258679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.290820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.294098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:07.325600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 900/1769] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:07.385381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.387727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:07.461514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e4439-829e-43f3-bb86-5b4ad09c08b2 service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.496243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.501008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.510154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.510154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] PATH_INFO: `/v3/projects/a82fc6fe0a3a4f74b1f5ab8357a7d691` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.518811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82fc6fe0a3a4f74b1f5ab8357a7d691)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.524002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:07.698024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82fc6fe0a3a4f74b1f5ab8357a7d691', 'request_id': 'req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.732096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82fc6fe0a3a4f74b1f5ab8357a7d691', 'request_id': 'req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.748195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82fc6fe0a3a4f74b1f5ab8357a7d691', 'request_id': 'req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.790821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] The token cache is being invalidate because project a82fc6fe0a3a4f74b1f5ab8357a7d691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:07.791371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.792519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.795661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 870/1770] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:07 2022] DELETE /identity/v3/projects/a82fc6fe0a3a4f74b1f5ab8357a7d691 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:07.800322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.826553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcd159-0918-458c-adb9-d428781eac8c service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.046992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.052053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.052053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.052053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] PATH_INFO: `/v3/users/49be4fa884734627982bf620df0d58af` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.054994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49be4fa884734627982bf620df0d58af)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.059634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.068104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:08.203548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49be4fa884734627982bf620df0d58af'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.227612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49be4fa884734627982bf620df0d58af'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.265056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49be4fa884734627982bf620df0d58af'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.267585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49be4fa884734627982bf620df0d58af'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.270190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49be4fa884734627982bf620df0d58af'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.290694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.297724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:08.359609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87ce8a-cf4f-4a0a-81a1-1f462772dbfa admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.385842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.386998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.387295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.387777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] PATH_INFO: `/v3/projects/57deb4116e9e4b7798c29c02b38e1d5f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.396718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57deb4116e9e4b7798c29c02b38e1d5f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.398760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.407324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 901/1771] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:07 2022] DELETE /identity/v3/users/49be4fa884734627982bf620df0d58af => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:08.408621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.411199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:08.528172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:08.586399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57deb4116e9e4b7798c29c02b38e1d5f', 'request_id': 'req-3eefb31a-9fa4-4ec3-ae38-483df51d3401'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.612894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57deb4116e9e4b7798c29c02b38e1d5f', 'request_id': 'req-3eefb31a-9fa4-4ec3-ae38-483df51d3401'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.631962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57deb4116e9e4b7798c29c02b38e1d5f', 'request_id': 'req-3eefb31a-9fa4-4ec3-ae38-483df51d3401'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.657456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] The token cache is being invalidate because project 57deb4116e9e4b7798c29c02b38e1d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:08.658217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.660498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:08.667093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 871/1772] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:08 2022] DELETE /identity/v3/projects/57deb4116e9e4b7798c29c02b38e1d5f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:08.668621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.670359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c951a-82a8-4e70-8288-bbe3be040b38 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.671284 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:08.857252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.858152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.858466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.858751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] PATH_INFO: `/v3/projects/37c130e4417f445ab54268ade8410abe` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.865634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c130e4417f445ab54268ade8410abe)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.867045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.939127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb31a-9fa4-4ec3-ae38-483df51d3401 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.952851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:08.964760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.967233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.967902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.969107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] PATH_INFO: `/v3/projects/96808c02d2e64ae19e31bdd5415d50c8` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.972701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96808c02d2e64ae19e31bdd5415d50c8)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.985206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:09.019393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c130e4417f445ab54268ade8410abe', 'request_id': 'req-06f76de7-df0b-4089-9d4d-95fe9014e408'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.047247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c130e4417f445ab54268ade8410abe', 'request_id': 'req-06f76de7-df0b-4089-9d4d-95fe9014e408'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.065903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c130e4417f445ab54268ade8410abe', 'request_id': 'req-06f76de7-df0b-4089-9d4d-95fe9014e408'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.109246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] The token cache is being invalidate because project 37c130e4417f445ab54268ade8410abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:09.109605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.113258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.130487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 902/1773] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:08 2022] DELETE /identity/v3/projects/37c130e4417f445ab54268ade8410abe => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:09.136694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.140068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.147280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96808c02d2e64ae19e31bdd5415d50c8', 'request_id': 'req-330942fd-d6f8-474e-8d6d-ff482c6015c3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.156608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96808c02d2e64ae19e31bdd5415d50c8', 'request_id': 'req-330942fd-d6f8-474e-8d6d-ff482c6015c3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.201392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96808c02d2e64ae19e31bdd5415d50c8', 'request_id': 'req-330942fd-d6f8-474e-8d6d-ff482c6015c3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.231374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] The token cache is being invalidate because project 96808c02d2e64ae19e31bdd5415d50c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:09.232988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.235330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.258513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 872/1774] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:08 2022] DELETE /identity/v3/projects/96808c02d2e64ae19e31bdd5415d50c8 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:09.259555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.266722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.391840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76de7-df0b-4089-9d4d-95fe9014e408 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:09.444247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:09.504440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330942fd-d6f8-474e-8d6d-ff482c6015c3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:09.529769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:09.530673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.531910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.532830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] PATH_INFO: `/v3/projects/d22dbcfb930d40a9b070c1a176f6ce68` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.535621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22dbcfb930d40a9b070c1a176f6ce68)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:09.539936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:09.618701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:09.619862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.620469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.620914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] PATH_INFO: `/v3/users/ea2b8f67a44c4c9f970ed2a5bba182c8` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.624242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2b8f67a44c4c9f970ed2a5bba182c8)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:09.626487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:09.727317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2b8f67a44c4c9f970ed2a5bba182c8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.754023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22dbcfb930d40a9b070c1a176f6ce68', 'request_id': 'req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.760292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2b8f67a44c4c9f970ed2a5bba182c8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.784711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2b8f67a44c4c9f970ed2a5bba182c8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.785876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22dbcfb930d40a9b070c1a176f6ce68', 'request_id': 'req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.793139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2b8f67a44c4c9f970ed2a5bba182c8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.796279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2b8f67a44c4c9f970ed2a5bba182c8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.801311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:09.824898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22dbcfb930d40a9b070c1a176f6ce68', 'request_id': 'req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.858308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 903/1775] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:09 2022] DELETE /identity/v3/users/ea2b8f67a44c4c9f970ed2a5bba182c8 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:09.860334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.868996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.911185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] The token cache is being invalidate because project d22dbcfb930d40a9b070c1a176f6ce68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:09.914762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.917183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.928808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 873/1776] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:09 2022] DELETE /identity/v3/projects/d22dbcfb930d40a9b070c1a176f6ce68 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:09.931073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.945865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.028589 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5c42-96c8-44f6-a385-60522a864655 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:10.035409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:10.036844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.037423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.037944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] PATH_INFO: `/v3/users/f6b4ba2f42644b18a9e5e9318b8f63d2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.039567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b4ba2f42644b18a9e5e9318b8f63d2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:10.042907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:10.174545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b4ba2f42644b18a9e5e9318b8f63d2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.196406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b4ba2f42644b18a9e5e9318b8f63d2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.211176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b4ba2f42644b18a9e5e9318b8f63d2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.212826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b4ba2f42644b18a9e5e9318b8f63d2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.214280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f1caa5ad-66cf-4b6f-8031-b1b217795dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b4ba2f42644b18a9e5e9318b8f63d2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.249895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 904/1777] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:09 2022] DELETE /identity/v3/users/f6b4ba2f42644b18a9e5e9318b8f63d2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:10.252909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e0c1-f3cf-4c88-8755-2cc02b6f720a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.253720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e0c1-f3cf-4c88-8755-2cc02b6f720a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.255715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e0c1-f3cf-4c88-8755-2cc02b6f720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.312419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47433bb-c014-4407-a2b2-d96c4fa0e7a0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:10.316512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a545e0c1-f3cf-4c88-8755-2cc02b6f720a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:10.319798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a545e0c1-f3cf-4c88-8755-2cc02b6f720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.595737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 905/1778] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:10.606189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.606691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.607150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.620904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:10.621804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.622098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.622381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] PATH_INFO: `/v3/users/4fa846cf462d45a1962be323aba36516` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.624296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:10.625662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa846cf462d45a1962be323aba36516)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:10.627660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:10.641387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:10.643816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.660335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 906/1779] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:10.666720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:10.680329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77012440-4815-426d-970e-5c8967b3ad02 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:10.687691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:10.703256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:10.722827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.723317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.724396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.728506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa846cf462d45a1962be323aba36516'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.730653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:10.732078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:10.745952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47118797-c110-436e-8fe5-f83f3f8bc40a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:10.746127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa846cf462d45a1962be323aba36516'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.762789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa846cf462d45a1962be323aba36516'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.764308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa846cf462d45a1962be323aba36516'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.764980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa846cf462d45a1962be323aba36516'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.805359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 907/1780] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:10.807322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.807610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.807943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.815941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 874/1781] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:09 2022] DELETE /identity/v3/users/4fa846cf462d45a1962be323aba36516 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:10.815941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:10.825163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.847339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] MFA Rules not processed for user `cb15a3e003fb4f0f8f876c5635b6a020`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:10.849247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.988438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 908/1782] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jun 16 00:28:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:11.029790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adca32-3bfa-4a81-b1cd-851c26adb98d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.053125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.053833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.054128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.054412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.055131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.057182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.074194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.075342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.103730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e5927-38df-462c-b669-86ddbe2e8e8f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.118004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.123916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.123916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.123916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] PATH_INFO: `/v3/projects/50475f43ea714f0fa6eee6c64c8b015a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.137260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=50475f43ea714f0fa6eee6c64c8b015a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.156920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 875/1783] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:10 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:11.157334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.158005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.301427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50475f43ea714f0fa6eee6c64c8b015a', 'request_id': 'req-cf4d7199-6d83-4543-ac59-327173d955ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.313699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50475f43ea714f0fa6eee6c64c8b015a', 'request_id': 'req-cf4d7199-6d83-4543-ac59-327173d955ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.341029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50475f43ea714f0fa6eee6c64c8b015a', 'request_id': 'req-cf4d7199-6d83-4543-ac59-327173d955ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.351350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60313ed-fc51-43d9-ae7e-2ea5279ac67b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.376263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] The token cache is being invalidate because project 50475f43ea714f0fa6eee6c64c8b015a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:11.381236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.382796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf4d7199-6d83-4543-ac59-327173d955ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.391405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 909/1784] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:11 2022] DELETE /identity/v3/projects/50475f43ea714f0fa6eee6c64c8b015a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:11.392975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a561d98-0067-4d84-85df-86c89238335d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.393278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a561d98-0067-4d84-85df-86c89238335d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.393575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a561d98-0067-4d84-85df-86c89238335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.443782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4a561d98-0067-4d84-85df-86c89238335d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:11.445656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4a561d98-0067-4d84-85df-86c89238335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.488992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:11.579730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 910/1785] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:11.579730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a561d98-0067-4d84-85df-86c89238335d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.581527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b437d-e0af-448d-8085-933464efc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.582350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b437d-e0af-448d-8085-933464efc513 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.582664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b437d-e0af-448d-8085-933464efc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.582962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b437d-e0af-448d-8085-933464efc513 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.585463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b437d-e0af-448d-8085-933464efc513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.585783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4a561d98-0067-4d84-85df-86c89238335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.587752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b437d-e0af-448d-8085-933464efc513 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.628195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 876/1786] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/users => generated 291 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:11.629826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.631573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.634393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.661837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:11.685833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:11.687590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.704993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 877/1787] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:11.706153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.712536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.736631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ea06-dbf0-4dd7-b33d-205dadeded4b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.774430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.775700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.777739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.780072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.781327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.785639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.821971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 878/1788] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:11.823154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.845406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a561d98-0067-4d84-85df-86c89238335d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.857260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7d069-79a3-4969-b08e-212abe6d7bf0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.857754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.869351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.869694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.870030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.873975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.879615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.882650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.882763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.882991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.883788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:11.884687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.890634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.901091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.902641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.921678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 879/1789] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:11.922610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.923908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 911/1790] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:11.924638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.930297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.966131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508b3fc-ea6f-4444-b255-b1227cc62309 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.996669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.997364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.997651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.997939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.999007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.000588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.002924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e55c8-09db-40c7-a3f8-67b9b016db97 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.023576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.024483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.024798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.025074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] PATH_INFO: `/v3/projects/6397377faa9b44d5aaf337bd95fa8b33` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.033099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6397377faa9b44d5aaf337bd95fa8b33)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.035010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.051918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 880/1791] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:12.051918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.092520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61ad78-9a55-40d8-afc8-a5708b17a857 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.112896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.113670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.114160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.115047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.115767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.118075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.196817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6397377faa9b44d5aaf337bd95fa8b33', 'request_id': 'req-52e88520-5ba8-4694-9d66-9fcbe441c7f0'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.206547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 881/1792] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/projects => generated 359 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:12.207735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.229520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6397377faa9b44d5aaf337bd95fa8b33', 'request_id': 'req-52e88520-5ba8-4694-9d66-9fcbe441c7f0'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.255149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6397377faa9b44d5aaf337bd95fa8b33', 'request_id': 'req-52e88520-5ba8-4694-9d66-9fcbe441c7f0'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.284537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] The token cache is being invalidate because project 6397377faa9b44d5aaf337bd95fa8b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:12.284884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.285852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.290165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 912/1793] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:11 2022] DELETE /identity/v3/projects/6397377faa9b44d5aaf337bd95fa8b33 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:12.292165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.296725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.470712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469362cd-e322-4ba8-a48d-836ab32f0c6b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.489434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92456b8f-ada0-432f-a672-be7898314108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.492205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92456b8f-ada0-432f-a672-be7898314108 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.494656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92456b8f-ada0-432f-a672-be7898314108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.495994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92456b8f-ada0-432f-a672-be7898314108 admin admin] PATH_INFO: `/v3/projects/2349a1b56b234acdaa01266d858aba57/users/f5ff8cd1c5b74366bb54dd0ac7ecdefc/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.546223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88520-5ba8-4694-9d66-9fcbe441c7f0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.548531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92456b8f-ada0-432f-a672-be7898314108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2349a1b56b234acdaa01266d858aba57, user_id=f5ff8cd1c5b74366bb54dd0ac7ecdefc, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.554544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92456b8f-ada0-432f-a672-be7898314108 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.571615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef19217-d995-498f-ac89-9a3bcac7280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.572365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19217-d995-498f-ac89-9a3bcac7280a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.572657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19217-d995-498f-ac89-9a3bcac7280a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.572939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef19217-d995-498f-ac89-9a3bcac7280a admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.574122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef19217-d995-498f-ac89-9a3bcac7280a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.576169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef19217-d995-498f-ac89-9a3bcac7280a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.611037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 882/1794] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:12 2022] PUT /identity/v3/projects/2349a1b56b234acdaa01266d858aba57/users/f5ff8cd1c5b74366bb54dd0ac7ecdefc/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:12.612866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.613314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.613750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.667310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:12.670045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.670200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 913/1795] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/users => generated 280 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:12.674391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d8d2-3d4d-490e-8973-268a60affec8 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.674701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d8d2-3d4d-490e-8973-268a60affec8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.675061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7d8d2-3d4d-490e-8973-268a60affec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.762921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-1fe7d8d2-3d4d-490e-8973-268a60affec8 None None] MFA Rules not processed for user `f5ff8cd1c5b74366bb54dd0ac7ecdefc`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:12.764366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1fe7d8d2-3d4d-490e-8973-268a60affec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.803270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:12.821871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:12.883003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 883/1796] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:12.900021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.950599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24990-2b79-4c0c-975c-10be14962c20 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.965877 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 914/1797] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:12.973455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.975719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.976151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.976583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.976913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.977207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.977494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.978264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.980211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.016402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:13.017999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.024413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 884/1798] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:13.040915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.041566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 915/1799] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:13.042889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.045491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.068317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb92e69-497a-443b-b401-82d3c081974f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.077210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.078632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.079040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.079982 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.081876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441c0ac-a93a-40ac-93fb-a794ba45b329 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.082413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.084936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.100848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.101549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.101835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.102129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.107414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.117998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.144157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 916/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:13.150158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.192427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f18d0-4910-4ac6-a21f-3b3e15286b0a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.195735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 885/1801] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:13.196641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.410868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.416786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.417349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.417831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.419511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:13.420042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.424970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.454206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 917/1802] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:13.459612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.491577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8333c5-dee5-417e-badd-fe3f3c129565 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.508420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.509530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.509940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.511334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.511334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.517953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.576924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 918/1803] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:13.576924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.608684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e8667-f4fa-4669-8be9-ec0dd7e89171 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.622954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.623816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.624247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.625652 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.626550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.630929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.705067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 919/1804] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:13.706219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.859621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a2803-51af-43f9-a9b3-09ab7b19337a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.919845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:13.929870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7ee79-0c3f-49cb-aa5b-90a74871d165 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.946179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.946875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.947177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.947485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.948271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.950056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.978987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 920/1805] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:13.980649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.001040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b756-67bc-4207-b743-65f09e00fa26 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.029729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.030444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.030739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.031025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.031863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.040452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.064996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.066084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.066446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.066829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] PATH_INFO: `/v3/projects/b0dfb190f570462fb9999f57272d5c4b/users/081120f99cf7483b9b41dbafbf2995d9/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.096540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 921/1806] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:14.097558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.133009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0dfb190f570462fb9999f57272d5c4b, user_id=081120f99cf7483b9b41dbafbf2995d9, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.139363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.146270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f60431-f51d-4bb0-bb78-555ba64462d8 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.162719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522098e8-e6a5-4246-9f48-7affaba550f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.168599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522098e8-e6a5-4246-9f48-7affaba550f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.169016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522098e8-e6a5-4246-9f48-7affaba550f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.169420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522098e8-e6a5-4246-9f48-7affaba550f7 admin admin] PATH_INFO: `/v3/projects/49380bdb3aff40f0947165a6e463d38a/users/8c2faecd7b0949f3b1947e03bd3e6c83/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.172696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 886/1807] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:13 2022] PUT /identity/v3/projects/b0dfb190f570462fb9999f57272d5c4b/users/081120f99cf7483b9b41dbafbf2995d9/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:14.186615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.226342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522098e8-e6a5-4246-9f48-7affaba550f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49380bdb3aff40f0947165a6e463d38a, user_id=8c2faecd7b0949f3b1947e03bd3e6c83, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.236892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522098e8-e6a5-4246-9f48-7affaba550f7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.293865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 922/1808] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:14 2022] PUT /identity/v3/projects/49380bdb3aff40f0947165a6e463d38a/users/8c2faecd7b0949f3b1947e03bd3e6c83/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:14.296018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.297544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.298859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.337989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:14.371771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497857-d262-4944-b5f0-ec11dc1566e3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.378242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] MFA Rules not processed for user `081120f99cf7483b9b41dbafbf2995d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:14.381204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:14.540592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.541563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.542025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.542461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.544465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.557958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.576594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 923/1809] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:14.576785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.595503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 887/1810] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:14.597600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.603317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:14.603822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f81ec-c433-4c23-a119-08fcd3198ebe None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.621750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.622770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.624714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.624954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.626234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.635760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.638913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d0a0-737e-43ac-b86a-125dd76d6e80 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.653024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.654197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.654650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.655097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] PATH_INFO: `/v3/projects/c665aafd74dd4de8a3d1364dc35ddda0` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.658649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c665aafd74dd4de8a3d1364dc35ddda0)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.661278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.668105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 924/1811] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:14.669404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.688753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eef36-59f1-462f-b956-50f197484943 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.699656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:14.700578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:14.701076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:14.701604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:14.704524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:14.706794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:14.753443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 925/1812] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:14 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:14.754824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.807369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c665aafd74dd4de8a3d1364dc35ddda0', 'request_id': 'req-bd7f4c01-fbda-46f5-9034-f98d13e46197'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:14.838846 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c665aafd74dd4de8a3d1364dc35ddda0', 'request_id': 'req-bd7f4c01-fbda-46f5-9034-f98d13e46197'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:14.873185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c665aafd74dd4de8a3d1364dc35ddda0', 'request_id': 'req-bd7f4c01-fbda-46f5-9034-f98d13e46197'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:14.890872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cd15e-1b45-4ccf-8783-b9aeb72c9c8e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:14.914359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:14.918607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] The token cache is being invalidate because project c665aafd74dd4de8a3d1364dc35ddda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:14.936421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:14.943794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:14.950118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 888/1813] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:14 2022] DELETE /identity/v3/projects/c665aafd74dd4de8a3d1364dc35ddda0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:14.951056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:14.954796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:15.034438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:15.035138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.035431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.035718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.037109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:15.038812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:15.061274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 926/1814] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:15.063096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:15.069085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:15.083789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de781d6-3230-4c47-90f4-e71335d50cd3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:15.117178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82c40-bda1-48e8-ac82-367594672c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:15.117948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82c40-bda1-48e8-ac82-367594672c36 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.118239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82c40-bda1-48e8-ac82-367594672c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.118528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82c40-bda1-48e8-ac82-367594672c36 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.119241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b82c40-bda1-48e8-ac82-367594672c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:15.121258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b82c40-bda1-48e8-ac82-367594672c36 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:15.163433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 927/1815] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:15 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:15.164939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.170262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.170566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.202869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f4c01-fbda-46f5-9034-f98d13e46197 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:15.205680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:15.206921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:15.229280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:15.231313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.231828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.232364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] PATH_INFO: `/v3/projects/49380bdb3aff40f0947165a6e463d38a/users/8c2faecd7b0949f3b1947e03bd3e6c83/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.236661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49380bdb3aff40f0947165a6e463d38a, user_id=8c2faecd7b0949f3b1947e03bd3e6c83, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:15.248765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 928/1816] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:15.249863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:15.251283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:15.256312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:15.276537 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dd5c7-9ed0-4206-b607-c3d83f739906 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:15.309342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 889/1817] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:14 2022] PUT /identity/v3/projects/49380bdb3aff40f0947165a6e463d38a/users/8c2faecd7b0949f3b1947e03bd3e6c83/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:15.312247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:15.352753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:15.461080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe34cb-b6bf-47b9-9d80-633821d42488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:15.462088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe34cb-b6bf-47b9-9d80-633821d42488 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.462374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe34cb-b6bf-47b9-9d80-633821d42488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.462781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe34cb-b6bf-47b9-9d80-633821d42488 admin admin] PATH_INFO: `/v3/projects/2701d59d5303427b95ba6402b6ec9603/users/82531fe1623a492096acc15150960215/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.511198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe34cb-b6bf-47b9-9d80-633821d42488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2701d59d5303427b95ba6402b6ec9603, user_id=82531fe1623a492096acc15150960215, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:15.527316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe34cb-b6bf-47b9-9d80-633821d42488 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:15.531837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f15f0-0c1b-486f-9c12-0496863d5226 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:15.545614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95264cea-6930-43db-96fa-037860a671df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:15.546808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264cea-6930-43db-96fa-037860a671df admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.547104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264cea-6930-43db-96fa-037860a671df admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.547480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264cea-6930-43db-96fa-037860a671df admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.548281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264cea-6930-43db-96fa-037860a671df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:15.551314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264cea-6930-43db-96fa-037860a671df admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:15.566247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 890/1818] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:15.568066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.568585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.569347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.576361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 929/1819] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:15 2022] PUT /identity/v3/projects/2701d59d5303427b95ba6402b6ec9603/users/82531fe1623a492096acc15150960215/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:15.581001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.582919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.583676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.614666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:15.617362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:15.723150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] MFA Rules not processed for user `8c2faecd7b0949f3b1947e03bd3e6c83`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:15.729219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 891/1820] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:15.732690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:15.735805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:15.781014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e1798-e1ca-4f9c-8ee1-1841a9c9945f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:15.798327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda867f6-ebfe-4d52-91a8-353fc3b0fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:15.799394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda867f6-ebfe-4d52-91a8-353fc3b0fdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.799786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda867f6-ebfe-4d52-91a8-353fc3b0fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.800398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda867f6-ebfe-4d52-91a8-353fc3b0fdc2 admin admin] PATH_INFO: `/v3/projects/2a7a2a37b7a042a0986cee66237f3e70/users/2aa8cfe09ed64297844eec31723f6adc/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.841612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda867f6-ebfe-4d52-91a8-353fc3b0fdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a2a37b7a042a0986cee66237f3e70, user_id=2aa8cfe09ed64297844eec31723f6adc, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:15.844469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda867f6-ebfe-4d52-91a8-353fc3b0fdc2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:15.866982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 892/1821] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:15 2022] PUT /identity/v3/projects/2a7a2a37b7a042a0986cee66237f3e70/users/2aa8cfe09ed64297844eec31723f6adc/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:15.868473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:15.868790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:15.869031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:15.877855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:15.890420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 930/1822] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:15.891317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:15.927334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b8e30-fc15-410e-a7c0-a1b5e5cf8d74 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:15.959098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] MFA Rules not processed for user `82531fe1623a492096acc15150960215`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:15.960835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:16.122382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 893/1823] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:16.123451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.127043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.129037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.129625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.130224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.131538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:16.132486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.139771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.149549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00a051-a50f-4ad9-8502-e3c88d348d14 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:16.164942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.166940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.166940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.166940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.167312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.168944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.178060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 931/1824] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:16.179035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.181622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:16.185449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:16.196833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 894/1825] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:16.196833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.232657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e936224-015f-4a18-88fd-06c664f73fe1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:16.259742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.260446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.260735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.261021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.261721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.263806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.322602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 895/1826] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:16 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:16.325096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.328322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07d917-2b2f-496d-9f1a-5addd91ba714 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:16.465752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.466460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.466757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.467124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.519207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee2687-d42a-4f72-9101-c763f9ef46fe admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:16.532228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.532918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.534288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.534851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.535569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.542550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.609104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 896/1827] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:16 2022] POST /identity/v3/projects => generated 371 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:16.610142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.625974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:16.632096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.633616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.686461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 932/1828] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:16.687244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.724631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857170-4456-475f-b1f5-60c419c12360 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:16.865445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395259-056f-4a9e-9e1a-ca0fe8d6d420 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:16.884327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.890950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.893034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.894646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] PATH_INFO: `/v3/projects/2a7a2a37b7a042a0986cee66237f3e70/users/2aa8cfe09ed64297844eec31723f6adc/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.910592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a2a37b7a042a0986cee66237f3e70, user_id=2aa8cfe09ed64297844eec31723f6adc, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.928760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.936702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:16.938288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:16.938927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:16.939216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:16.939954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:16.942377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:16.956592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 897/1829] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:16 2022] PUT /identity/v3/projects/2a7a2a37b7a042a0986cee66237f3e70/users/2aa8cfe09ed64297844eec31723f6adc/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:16.958723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:16.996439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 933/1830] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:16 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:16.997365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:17.062901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2334a-2dc9-4fe4-882f-245eac8ac588 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.064262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:17.073302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed570b1-ee07-4cd8-881d-04305d6641b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.076119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed570b1-ee07-4cd8-881d-04305d6641b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.076960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed570b1-ee07-4cd8-881d-04305d6641b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.077591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed570b1-ee07-4cd8-881d-04305d6641b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.078555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed570b1-ee07-4cd8-881d-04305d6641b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:17.082561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed570b1-ee07-4cd8-881d-04305d6641b4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:17.145015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 898/1831] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:16 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:17.150175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.150370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.150690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.229103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] MFA Rules not processed for user `2aa8cfe09ed64297844eec31723f6adc`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:17.230640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:17.352418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c94a03-721e-4e7f-9d8a-9487fddc29c7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.438081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.438904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.440058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.440354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.445874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:17.471783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 899/1832] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:17.473309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:17.507305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa94f38-66dc-4d43-aec8-774e4576d046 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.530558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.531262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.531560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.532404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.533165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:17.534801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:17.549097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 900/1833] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:17.549983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:17.578977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d82dd-4a98-4a41-8bfb-eebbe3fcad7a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.594135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.594844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.595139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.595428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.596215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:17.603456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:17.622666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 901/1834] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:17.623752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:17.644184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:17.653427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:17.656160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e922401-c31c-44e6-a18b-8cecbcd13c77 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.660107 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:17.669916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.670867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.671157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.671497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] PATH_INFO: `/v3/projects/fee0fe0370bb4ce4a98badfd4b191a99/users/2a0f6e36294e4d179a19e6b1d2047aaf/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.690210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee0fe0370bb4ce4a98badfd4b191a99, user_id=2a0f6e36294e4d179a19e6b1d2047aaf, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:17.694384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 934/1835] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:17.699993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:17.701513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:17.704633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:17.738741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 902/1836] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:17 2022] PUT /identity/v3/projects/fee0fe0370bb4ce4a98badfd4b191a99/users/2a0f6e36294e4d179a19e6b1d2047aaf/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:17.739387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fba70-b7f0-4515-83ab-30c8d11a8709 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.740662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:17.902052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.903180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.904735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.905010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.954701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167073ee-8cb6-48a8-9e27-2d89c4a1a9e3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:17.971370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:17.972115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:17.972409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:17.972695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:17.973465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:17.975948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.006063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 903/1837] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:18.007959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:18.032949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7be1-1564-4883-8983-1fa5b2e6a90c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:18.045930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:18.046681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.047156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.047450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.048228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:18.054092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.082293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 904/1838] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:18.083854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:18.099380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274903d1-7192-4de0-99b6-4a2953c6552b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:18.109552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:18.113123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.114176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b08bb0-8855-471b-bc7b-0c01323130e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:18.115494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b08bb0-8855-471b-bc7b-0c01323130e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.116063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b08bb0-8855-471b-bc7b-0c01323130e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.116360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b08bb0-8855-471b-bc7b-0c01323130e8 admin admin] PATH_INFO: `/v3/projects/af09b340c00d472fb1de392cf772a3b5/users/718db532b5f34030b14bb2af95f9b530/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.125855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:18.163963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b08bb0-8855-471b-bc7b-0c01323130e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af09b340c00d472fb1de392cf772a3b5, user_id=718db532b5f34030b14bb2af95f9b530, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:18.167797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b08bb0-8855-471b-bc7b-0c01323130e8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.168869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 935/1839] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:18.173476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:18.207790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 905/1840] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:18 2022] PUT /identity/v3/projects/af09b340c00d472fb1de392cf772a3b5/users/718db532b5f34030b14bb2af95f9b530/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:18.211363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.211540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.212706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.220307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f3e92-c781-429c-97f9-358cc7673011 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:18.267825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:18.270022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:18.479650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:18.480966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.481205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.481931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] PATH_INFO: `/v3/projects/fee0fe0370bb4ce4a98badfd4b191a99/users/2a0f6e36294e4d179a19e6b1d2047aaf/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.483705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee0fe0370bb4ce4a98badfd4b191a99, user_id=2a0f6e36294e4d179a19e6b1d2047aaf, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:18.486539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.523606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 936/1841] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:18 2022] PUT /identity/v3/projects/fee0fe0370bb4ce4a98badfd4b191a99/users/2a0f6e36294e4d179a19e6b1d2047aaf/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:18.526093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:18.571400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 906/1842] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:18.572448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:18.610134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4af40-e70c-4b1c-84a3-9b7f43503443 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:18.672000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:18.720505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fdffd-5bfa-4966-8832-12e7bd9866fc admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:18.740048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:18.740743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.741037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.741597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.746749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:18.808968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:18.812524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.812719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.812903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] PATH_INFO: `/v3/users/f5ff8cd1c5b74366bb54dd0ac7ecdefc` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.816245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ff8cd1c5b74366bb54dd0ac7ecdefc)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:18.819342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.890544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:18.892361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be2ff0-1a57-4e98-857a-04584ebbca66 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:18.930415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 937/1843] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:18 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:18.936036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df09d98-5214-469c-94d9-e41b3942a03b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:18.936265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df09d98-5214-469c-94d9-e41b3942a03b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:18.939241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df09d98-5214-469c-94d9-e41b3942a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:18.996064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ff8cd1c5b74366bb54dd0ac7ecdefc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.021873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ff8cd1c5b74366bb54dd0ac7ecdefc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.030852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2df09d98-5214-469c-94d9-e41b3942a03b None None] MFA Rules not processed for user `2a0f6e36294e4d179a19e6b1d2047aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:19.033873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2df09d98-5214-469c-94d9-e41b3942a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.051762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ff8cd1c5b74366bb54dd0ac7ecdefc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.057003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ff8cd1c5b74366bb54dd0ac7ecdefc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.059850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b276286e-b05c-4d70-81b6-195a7899e3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ff8cd1c5b74366bb54dd0ac7ecdefc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.149332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 907/1844] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:18 2022] DELETE /identity/v3/users/f5ff8cd1c5b74366bb54dd0ac7ecdefc => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:19.154755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a74907-a304-4d1c-8373-dead5fff3179 None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.155052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a74907-a304-4d1c-8373-dead5fff3179 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.159686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a74907-a304-4d1c-8373-dead5fff3179 None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.167586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 908/1845] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:28:19 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:28:19.180705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a74907-a304-4d1c-8373-dead5fff3179 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:19.194472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-32a74907-a304-4d1c-8373-dead5fff3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.230411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:19.402346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 938/1846] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:19.406908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ffb4a-4be1-430f-a3a9-93136101f4e9 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.407191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ffb4a-4be1-430f-a3a9-93136101f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.407473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ffb4a-4be1-430f-a3a9-93136101f4e9 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.417012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 939/1847] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:28:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:28:19.420308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d54dfb-d54f-43e3-af9e-f9230de1299c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.421296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d54dfb-d54f-43e3-af9e-f9230de1299c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.421296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d54dfb-d54f-43e3-af9e-f9230de1299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.484410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a74907-a304-4d1c-8373-dead5fff3179 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:19.486801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-69d54dfb-d54f-43e3-af9e-f9230de1299c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:19.488048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-69d54dfb-d54f-43e3-af9e-f9230de1299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.498156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:19.498792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.499081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.499394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.509812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.709950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 940/1848] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:19.711305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2477d-97cb-410b-aae6-d2fb17b79c95 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.711599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2477d-97cb-410b-aae6-d2fb17b79c95 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.711899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2477d-97cb-410b-aae6-d2fb17b79c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.739236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:19.743051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:19.772831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 909/1849] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:19.779165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:19.784385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.787520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-9cf2477d-97cb-410b-aae6-d2fb17b79c95 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:19.788838 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9cf2477d-97cb-410b-aae6-d2fb17b79c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.838199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:19.942121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b3b2-a828-496c-b0be-74cd88d74254 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:19.962219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:19.963020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.964121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.964424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.009625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 941/1850] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:28:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:20.011374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.011920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.012707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.045547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:20.046817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.059087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 942/1851] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:28:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:20.060198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.061544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.075232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a8cc0-a2c5-4a66-8ecd-94f897a021b8 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.080389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.081487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.082102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.082591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.098955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.100599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.113232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.113963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 910/1852] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:20.118728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.146602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 943/1853] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:20.238772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.244774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:20.250186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7c9e-b1b1-43ab-95d8-5eb0174478e3 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.255578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.256293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.256583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.256863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.259099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.364258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.366030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.378672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 911/1854] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:20.393144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.395219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.426989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdc66a-5737-4161-abe9-85162038a10a service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.439068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.440456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.440849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.441637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.457179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.460449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.482208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 944/1855] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:20.589452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.590939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.625634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e1844-7c9e-4e8f-99e5-300a038bbb12 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.629658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.631294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.634172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.636394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.636811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.637291 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] PATH_INFO: `/v3/projects/2349a1b56b234acdaa01266d858aba57` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.640318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2349a1b56b234acdaa01266d858aba57)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.647886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.663406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731514b4-4c5b-44ca-8fa7-fee6a72cf1f0 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.690258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.690968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.691260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.691544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.713901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.715444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.727601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 945/1856] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:20.788205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2349a1b56b234acdaa01266d858aba57', 'request_id': 'req-79914a14-8bdb-4225-a8d0-5499af9a93ee'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.800017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2349a1b56b234acdaa01266d858aba57', 'request_id': 'req-79914a14-8bdb-4225-a8d0-5499af9a93ee'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.813716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2349a1b56b234acdaa01266d858aba57', 'request_id': 'req-79914a14-8bdb-4225-a8d0-5499af9a93ee'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.840432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] The token cache is being invalidate because project 2349a1b56b234acdaa01266d858aba57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:20.840977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.843001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-79914a14-8bdb-4225-a8d0-5499af9a93ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.846532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 912/1857] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:20 2022] DELETE /identity/v3/projects/2349a1b56b234acdaa01266d858aba57 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:20.852389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.880979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b074a86-d9ee-48da-99a6-4b99bf5a36b6 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.023620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.024686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.026216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.027253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] PATH_INFO: `/v3/users/8c2faecd7b0949f3b1947e03bd3e6c83` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.029015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2faecd7b0949f3b1947e03bd3e6c83)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.034469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.138810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2faecd7b0949f3b1947e03bd3e6c83'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.149933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2faecd7b0949f3b1947e03bd3e6c83'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.159188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2faecd7b0949f3b1947e03bd3e6c83'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.160489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2faecd7b0949f3b1947e03bd3e6c83'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.162177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2faecd7b0949f3b1947e03bd3e6c83'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.168465 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.194901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 946/1858] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:20 2022] DELETE /identity/v3/users/8c2faecd7b0949f3b1947e03bd3e6c83 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:21.327759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.328124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.328422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.365020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] MFA Rules not processed for user `718db532b5f34030b14bb2af95f9b530`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.366331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.545481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 913/1859] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:21.549682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.551246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.560088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.568459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.614242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.686784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d17631-352d-4c37-a50e-c08450c1d7ba admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.693947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.694747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc7930-6407-458f-8495-5bf4e7f6b14f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.694999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.695427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.696411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.697282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.699361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.701054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.702020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.702509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.702779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] PATH_INFO: `/v3/users/91b184e8cd0d4f7fbc5d0e71927ded67` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.704187 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b184e8cd0d4f7fbc5d0e71927ded67)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.706683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.746264 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 947/1860] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:21.747604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.812730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b184e8cd0d4f7fbc5d0e71927ded67'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.825722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b184e8cd0d4f7fbc5d0e71927ded67'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.836066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b184e8cd0d4f7fbc5d0e71927ded67'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.837474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b184e8cd0d4f7fbc5d0e71927ded67'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.838115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-642351b5-add1-4315-a0da-a5f36de57e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b184e8cd0d4f7fbc5d0e71927ded67'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.841811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc5f18-2280-4a1e-9fbf-327dadf5c9ac admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.847704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.849272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.849742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.850036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.851277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.857326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.859997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 914/1861] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:21 2022] DELETE /identity/v3/users/91b184e8cd0d4f7fbc5d0e71927ded67 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:21.865886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.866287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.866693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.894030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.894281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 948/1862] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:21.895487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.897955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.900262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.920571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16abe-1d6e-4d22-b464-a71e1d3589c3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.004128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 915/1863] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.016532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.019122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.022561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.023892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.024529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.025255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.026637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.028902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.032595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:22.098757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:22.119405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 949/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:22.120119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.132240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac609b3-2f6f-42d8-bbb5-7ecfc668d697 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.137459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.140386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.140622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.141315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.141917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.159277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.162152 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.167430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d5ebf-e27d-41e5-ac16-ea7eb2d4e218 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.173047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.174015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.174376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.174751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] PATH_INFO: `/v3/projects/49380bdb3aff40f0947165a6e463d38a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.178696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49380bdb3aff40f0947165a6e463d38a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.180762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.193467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 916/1865] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:22.198603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.235238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc373c4-2ac7-40cb-8ed6-90c63db87416 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.257165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.260056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.260370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.261568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] PATH_INFO: `/v3/projects/55b8c61f138a4a97864f3b55406b90a5/users/b3eea7ff73cd469cbafda78d92c5f64c/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.299369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49380bdb3aff40f0947165a6e463d38a', 'request_id': 'req-e9957425-ca6f-4da3-9e3f-e709b1f2b259'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.303664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8c61f138a4a97864f3b55406b90a5, user_id=b3eea7ff73cd469cbafda78d92c5f64c, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.313963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.314475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49380bdb3aff40f0947165a6e463d38a', 'request_id': 'req-e9957425-ca6f-4da3-9e3f-e709b1f2b259'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.333967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49380bdb3aff40f0947165a6e463d38a', 'request_id': 'req-e9957425-ca6f-4da3-9e3f-e709b1f2b259'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.348865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 917/1866] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:22 2022] PUT /identity/v3/projects/55b8c61f138a4a97864f3b55406b90a5/users/b3eea7ff73cd469cbafda78d92c5f64c/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:22.354048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.368482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] The token cache is being invalidate because project 49380bdb3aff40f0947165a6e463d38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:22.368592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.370251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e9957425-ca6f-4da3-9e3f-e709b1f2b259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.376806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 950/1867] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:22 2022] DELETE /identity/v3/projects/49380bdb3aff40f0947165a6e463d38a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:22.383909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb786cf-3838-4a47-b755-68907db2a032 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.384109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb786cf-3838-4a47-b755-68907db2a032 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.384936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb786cf-3838-4a47-b755-68907db2a032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.406915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3fb786cf-3838-4a47-b755-68907db2a032 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:22.408487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3fb786cf-3838-4a47-b755-68907db2a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.508028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 951/1868] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.509484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a89d3-d1dd-4183-94f6-0456641eb918 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.518549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.518785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.518917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.519140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.519534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.519829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.520146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.521633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.524847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.541426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 918/1869] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:22.549144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.551210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.562299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:22.564355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.571512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61393752-5a41-4303-9edd-0b8a2ff879e6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.578183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 952/1870] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.579426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.582577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.583516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.584791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.585492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] PATH_INFO: `/v3/projects/55b8c61f138a4a97864f3b55406b90a5/users/b3eea7ff73cd469cbafda78d92c5f64c/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.590516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8c61f138a4a97864f3b55406b90a5, user_id=b3eea7ff73cd469cbafda78d92c5f64c, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.593586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.601118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29f7f-269f-4934-beee-bfbb456b58b3 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.607053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.608123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.608451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.608898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.609919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:22.610187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.612064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.619538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 919/1871] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:22 2022] PUT /identity/v3/projects/55b8c61f138a4a97864f3b55406b90a5/users/b3eea7ff73cd469cbafda78d92c5f64c/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:22.627920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 953/1872] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:22.634123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.738273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a69c8-09b0-4359-b272-a1118b6fc7c0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.751784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.752691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.753074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.753456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.754257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.757241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.798962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 920/1873] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:22 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:22.803157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.815159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bccf5-673a-41f0-875d-bf10b8937c05 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.889334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.890028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.890314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.890760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.892049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.894659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.903294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:22.923660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 954/1874] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:22 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:22.928962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.941084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16386f4-2f40-46ed-911d-f6f70fdc5902 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.946092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.946993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.947215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.947502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.948584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.950602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.965847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 921/1875] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:22.969929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.983621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963be10-f9df-4b33-87c3-4e0f8858d9e3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.990745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.991436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.991727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.992053 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.993031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.994428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.008038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 955/1876] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:23.010516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.030850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b08cf2-0351-40aa-b013-16695f890620 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.050821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f6444-fdea-4fe9-8641-54d4c946350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.053165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6444-fdea-4fe9-8641-54d4c946350c admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.054363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6444-fdea-4fe9-8641-54d4c946350c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.054731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6444-fdea-4fe9-8641-54d4c946350c admin admin] PATH_INFO: `/v3/projects/973c33f5529f44228683df726dd4ba4f/users/92b15e01c89949fc965263718c79cb73/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.079855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:23.104791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f6444-fdea-4fe9-8641-54d4c946350c admin admin] RBAC: Authorizing `identity:create_grant(project_id=973c33f5529f44228683df726dd4ba4f, user_id=92b15e01c89949fc965263718c79cb73, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.110582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f6444-fdea-4fe9-8641-54d4c946350c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.128833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.130947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.140041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 922/1877] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:23 2022] PUT /identity/v3/projects/973c33f5529f44228683df726dd4ba4f/users/92b15e01c89949fc965263718c79cb73/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:23.156620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.159747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.160108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.164992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1a67f-1f0f-4ecd-8048-51c3518af794 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.223532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] MFA Rules not processed for user `92b15e01c89949fc965263718c79cb73`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:23.225370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.252400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.254197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.254576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.256173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] PATH_INFO: `/v3/projects/e1ef57f873ed4f679cf1a685c9a3f1ac` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.257109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ef57f873ed4f679cf1a685c9a3f1ac)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.259323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.314288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 923/1878] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:23.319857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.320086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ef57f873ed4f679cf1a685c9a3f1ac', 'request_id': 'req-44d0412d-ed79-478f-a31c-28734968dfd5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.330317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ef57f873ed4f679cf1a685c9a3f1ac', 'request_id': 'req-44d0412d-ed79-478f-a31c-28734968dfd5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.332993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91307fe-7cad-4ef8-aa32-749867a96a66 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.339064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ef57f873ed4f679cf1a685c9a3f1ac', 'request_id': 'req-44d0412d-ed79-478f-a31c-28734968dfd5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.365559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] The token cache is being invalidate because project e1ef57f873ed4f679cf1a685c9a3f1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:23.365915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.366664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.368784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 956/1879] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:23 2022] DELETE /identity/v3/projects/e1ef57f873ed4f679cf1a685c9a3f1ac => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:23.373335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.374894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.450142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.450834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.451120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.451396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.452171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.455545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.491204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0412d-ed79-478f-a31c-28734968dfd5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.499065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.500054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 924/1880] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:23.500394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.500691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.500977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] PATH_INFO: `/v3/users/c29f3b8b00b340a6ae3a9b33fcaf2a38` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.506511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29f3b8b00b340a6ae3a9b33fcaf2a38)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.506686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.506784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.507338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.524583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:23.611120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29f3b8b00b340a6ae3a9b33fcaf2a38'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.621454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787de30-6b82-4c4a-81dd-3ff00558bef7 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.623732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29f3b8b00b340a6ae3a9b33fcaf2a38'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.627651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.628511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.628865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.629202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.630185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.632491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.634559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29f3b8b00b340a6ae3a9b33fcaf2a38'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.635382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29f3b8b00b340a6ae3a9b33fcaf2a38'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.636603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29f3b8b00b340a6ae3a9b33fcaf2a38'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.640787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:23.657504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 925/1881] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:23.658544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.659567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 957/1882] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:23 2022] DELETE /identity/v3/users/c29f3b8b00b340a6ae3a9b33fcaf2a38 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:23.664959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.665867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.666669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.680343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5d0f5-e7fd-4f43-991d-075fdd73795c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.747581 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df7ab-b03b-425a-97ce-a66d27d6f44d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.753881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.754580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.755565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.755867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.756764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.758387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.769696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 958/1883] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:23.773800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.787826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.789368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a42f-2651-4bdd-9b4e-649a1b425fcf admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.789798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.790212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.790619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] PATH_INFO: `/v3/users/82531fe1623a492096acc15150960215` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.793406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82531fe1623a492096acc15150960215)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.795843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce28e1-d2e4-4d1e-b36a-687794e6c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.796815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce28e1-d2e4-4d1e-b36a-687794e6c183 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.797013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce28e1-d2e4-4d1e-b36a-687794e6c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.797245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce28e1-d2e4-4d1e-b36a-687794e6c183 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.797602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.797993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce28e1-d2e4-4d1e-b36a-687794e6c183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.799608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce28e1-d2e4-4d1e-b36a-687794e6c183 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.826717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 959/1884] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:23.826717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9d50-3c42-4750-9cf7-e8656ed536d2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.826717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9d50-3c42-4750-9cf7-e8656ed536d2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.826717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9d50-3c42-4750-9cf7-e8656ed536d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.869284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7cfc9d50-3c42-4750-9cf7-e8656ed536d2 None None] MFA Rules not processed for user `b3eea7ff73cd469cbafda78d92c5f64c`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:23.870523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7cfc9d50-3c42-4750-9cf7-e8656ed536d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.896987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82531fe1623a492096acc15150960215'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.905593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82531fe1623a492096acc15150960215'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.915390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82531fe1623a492096acc15150960215'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.916680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82531fe1623a492096acc15150960215'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.917319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82531fe1623a492096acc15150960215'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:23.941483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 926/1885] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:23 2022] DELETE /identity/v3/users/82531fe1623a492096acc15150960215 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:23.941483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.941483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.971217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:23.985050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 960/1886] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:23.986486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.987042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.987861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.010544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.012092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.030714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1c853-1fec-4e38-b70c-e668eaf28b20 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.040994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090b685-e9fc-4e98-a56b-9bc74ef2d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.041953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090b685-e9fc-4e98-a56b-9bc74ef2d036 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.042238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090b685-e9fc-4e98-a56b-9bc74ef2d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.042526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090b685-e9fc-4e98-a56b-9bc74ef2d036 admin admin] PATH_INFO: `/v3/projects/548130c04c05441398a2ba4faacff27a/users/1724f1cc32424af1aa2d1f3cdc1fcc7a/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.076125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090b685-e9fc-4e98-a56b-9bc74ef2d036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548130c04c05441398a2ba4faacff27a, user_id=1724f1cc32424af1aa2d1f3cdc1fcc7a, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.078843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090b685-e9fc-4e98-a56b-9bc74ef2d036 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.081288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:24.099483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 927/1887] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:23 2022] PUT /identity/v3/projects/548130c04c05441398a2ba4faacff27a/users/1724f1cc32424af1aa2d1f3cdc1fcc7a/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:24.109507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05bedd-106c-4384-9d01-e5c76040e837 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.109507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05bedd-106c-4384-9d01-e5c76040e837 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.109507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05bedd-106c-4384-9d01-e5c76040e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.109885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 961/1888] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:24.109885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.109885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.123365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dc6d0-6e0c-4daf-b0a6-2a53846700da None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.142371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6d05bedd-106c-4384-9d01-e5c76040e837 None None] MFA Rules not processed for user `718db532b5f34030b14bb2af95f9b530`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.143906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6d05bedd-106c-4384-9d01-e5c76040e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.216021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 928/1889] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:24.217414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.217736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.218457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.244629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.246124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.246623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.247506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] PATH_INFO: `/v3/projects/b4386f78e686414c852c8fa8a1f5ac4c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.249757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4386f78e686414c852c8fa8a1f5ac4c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.251128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] MFA Rules not processed for user `1724f1cc32424af1aa2d1f3cdc1fcc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.252481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.253129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.353115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4386f78e686414c852c8fa8a1f5ac4c', 'request_id': 'req-e25e411b-66f3-4f2b-98b5-f046baaddb42'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:24.353292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 929/1890] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:24.353292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.354569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.361743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4386f78e686414c852c8fa8a1f5ac4c', 'request_id': 'req-e25e411b-66f3-4f2b-98b5-f046baaddb42'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:24.370303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4386f78e686414c852c8fa8a1f5ac4c', 'request_id': 'req-e25e411b-66f3-4f2b-98b5-f046baaddb42'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:24.387755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] The token cache is being invalidate because project b4386f78e686414c852c8fa8a1f5ac4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:24.387978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:24.388574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:24.390698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 962/1891] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:24 2022] DELETE /identity/v3/projects/b4386f78e686414c852c8fa8a1f5ac4c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:24.391444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.392775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.431437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:24.452294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be904-2d9f-41fb-88b4-a6785c3ad07a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.480374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e411b-66f3-4f2b-98b5-f046baaddb42 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.485295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.485974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.486265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.486548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.487255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.491625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.522975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:24.526426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 963/1892] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:24.527366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.529246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.540357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.541803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.542203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.542597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.544965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.559574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.561232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e5ce7-d2f2-41b5-8d2e-78e4885588bf service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.574658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 930/1893] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:24.581080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.581542 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.581900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.628369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.631514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.678910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134802ac-39d0-4df1-9141-e740740765bf admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.688231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.688969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.689266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.689863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.691889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.712701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 931/1894] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:24.720614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.734489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa12778-65e6-43d8-a52e-5bc5f7f0b613 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.742527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d334da-2420-4acf-800e-e5b3ef21e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.743225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d334da-2420-4acf-800e-e5b3ef21e97b admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.743516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d334da-2420-4acf-800e-e5b3ef21e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.744894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d334da-2420-4acf-800e-e5b3ef21e97b admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.745620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d334da-2420-4acf-800e-e5b3ef21e97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.748110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d334da-2420-4acf-800e-e5b3ef21e97b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.778969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 932/1895] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/users => generated 295 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:24.780316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.780614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.780902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.782941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.785172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.800889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 964/1896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:24.802175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.814043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.815561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.819375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150565de-b478-43e4-9b3d-e99a7b524676 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.826808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.827734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.828063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.828483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.829227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.831515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.844568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 933/1897] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:24.849460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.868631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72206b6-61a6-44e0-95f4-1ed2c0b85a0f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.876626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.877648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.878237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.878735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.880731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:24.882294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.882408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 965/1898] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:24.883460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.884953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.904514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 934/1899] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:28:24.908109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac896560-aad2-4f02-9307-02750ceadb45 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.908557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.916091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.917003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.917294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.917577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] PATH_INFO: `/v3/projects/7a14704614fe459185b8f0927e8f73e0/users/7d08858a0e0b4171bced412b4a840d3e/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.922222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd4a6-14f3-4a6e-913e-1071e72a5349 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.927479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.929214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.929603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.930386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.930804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.932891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.935637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a14704614fe459185b8f0927e8f73e0, user_id=7d08858a0e0b4171bced412b4a840d3e, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.938470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.954818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 966/1900] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:24 2022] PUT /identity/v3/projects/7a14704614fe459185b8f0927e8f73e0/users/7d08858a0e0b4171bced412b4a840d3e/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:24.959351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.969580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 935/1901] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:24.975342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.993524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:25.064547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e72a-e8ac-4f2c-9180-ab1d9302bf29 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.071036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.071780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.072094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.072392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.073903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.075152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f729-199d-48f1-91cb-a87d8dd21b4c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.077142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.081149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.081727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.082018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.082300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.083643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.085309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.102609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 967/1902] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:25.104138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.106359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.119010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 936/1903] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:25.120503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.125866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80202a7b-c852-4cd4-bd9b-aea17916c24d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.131220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.132130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.132423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.132705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] PATH_INFO: `/v3/projects/2701d59d5303427b95ba6402b6ec9603` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.134086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2701d59d5303427b95ba6402b6ec9603)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.136082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.139451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4f71-4bfb-4120-af2e-d06c0988f56e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.145904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.146867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.147675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.147675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] PATH_INFO: `/v3/projects/7a14704614fe459185b8f0927e8f73e0/users/7d08858a0e0b4171bced412b4a840d3e/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.149849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a14704614fe459185b8f0927e8f73e0, user_id=7d08858a0e0b4171bced412b4a840d3e, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.152616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.169928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 937/1904] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:25 2022] PUT /identity/v3/projects/7a14704614fe459185b8f0927e8f73e0/users/7d08858a0e0b4171bced412b4a840d3e/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:25.171071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.177664 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:25.202079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2701d59d5303427b95ba6402b6ec9603', 'request_id': 'req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.210056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2701d59d5303427b95ba6402b6ec9603', 'request_id': 'req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.218290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2701d59d5303427b95ba6402b6ec9603', 'request_id': 'req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.233254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] The token cache is being invalidate because project 2701d59d5303427b95ba6402b6ec9603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:25.233626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.234245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7c87dfba-9b57-4a6a-9fce-4f47db34b3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.236327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 968/1905] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:25 2022] DELETE /identity/v3/projects/2701d59d5303427b95ba6402b6ec9603 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:25.237274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.237571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.237851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.251382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f42546-92bf-444d-a257-df657ca0fa40 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.266549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] MFA Rules not processed for user `7d08858a0e0b4171bced412b4a840d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:25.267861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.315024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.315635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.315960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.316251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.316999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.318864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.334687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 938/1906] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:25.335663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.337567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.354229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc1d7-7c65-4ad3-bc77-5dc407369537 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.361460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.362437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.362738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.363068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] PATH_INFO: `/v3/users/2a0f6e36294e4d179a19e6b1d2047aaf` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.363244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 969/1907] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:25.364156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.365054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0f6e36294e4d179a19e6b1d2047aaf)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.365549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.367810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.382686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbd3d3-2763-4a4f-864a-9735f4124ae5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.388470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.390576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.390870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.391158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.391946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.393597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.411867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 970/1908] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:25.413297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.415383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.427972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:25.432465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0f6e36294e4d179a19e6b1d2047aaf'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.441264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0f6e36294e4d179a19e6b1d2047aaf'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.450747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0f6e36294e4d179a19e6b1d2047aaf'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.451513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0f6e36294e4d179a19e6b1d2047aaf'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.452244 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0f6e36294e4d179a19e6b1d2047aaf'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:25.475917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 939/1909] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:25 2022] DELETE /identity/v3/users/2a0f6e36294e4d179a19e6b1d2047aaf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:25.476815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.478381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.487466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56efb-fdf1-4f50-a68f-6c6ed433b87f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.505679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:25.565366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.566145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.569785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.570687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.573608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.574059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730efa-0d68-4797-82dc-640f95d039df admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.580633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d93f9-2480-49b2-af73-2dcb194bd0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:25.581604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d93f9-2480-49b2-af73-2dcb194bd0be admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.581938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d93f9-2480-49b2-af73-2dcb194bd0be admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.582225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d93f9-2480-49b2-af73-2dcb194bd0be admin admin] PATH_INFO: `/v3/projects/1cb9e9592a654c97bbf432a648b2732b/users/d0582dbe11894a0fbf151c3527955bae/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.603807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d93f9-2480-49b2-af73-2dcb194bd0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb9e9592a654c97bbf432a648b2732b, user_id=d0582dbe11894a0fbf151c3527955bae, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.607336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d93f9-2480-49b2-af73-2dcb194bd0be admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.639029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 940/1910] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:25 2022] PUT /identity/v3/projects/1cb9e9592a654c97bbf432a648b2732b/users/d0582dbe11894a0fbf151c3527955bae/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:25.650983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:25.651285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:25.651584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.664440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.666362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.678153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 971/1911] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:25.689727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] MFA Rules not processed for user `d0582dbe11894a0fbf151c3527955bae`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:25.693703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.830361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:25.831927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:25.865942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def59e3-df66-4909-b6d5-b608f22b6792 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:25.870336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 941/1912] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:25.874305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.008040 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.009026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.009324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.009610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] PATH_INFO: `/v3/projects/fee0fe0370bb4ce4a98badfd4b191a99` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.012260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee0fe0370bb4ce4a98badfd4b191a99)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.018764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.045230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02386bfe-61bf-43ee-b130-1ccd5401ecc7 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.063685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.064672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.065190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.065830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.066453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:26.068656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.075780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.133047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 942/1913] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:25 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:26.135718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.138097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee0fe0370bb4ce4a98badfd4b191a99', 'request_id': 'req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:26.151199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee0fe0370bb4ce4a98badfd4b191a99', 'request_id': 'req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:26.161807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee0fe0370bb4ce4a98badfd4b191a99', 'request_id': 'req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:26.189274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] The token cache is being invalidate because project fee0fe0370bb4ce4a98badfd4b191a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:26.189911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:26.191912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-be47bdcb-1cf2-414d-b7d4-2e3d1dcd3846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:26.195153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 972/1914] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:25 2022] DELETE /identity/v3/projects/fee0fe0370bb4ce4a98badfd4b191a99 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:26.200934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd14db-e4c5-4105-a5ef-b7a82de44a4a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.201428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd14db-e4c5-4105-a5ef-b7a82de44a4a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.202112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd14db-e4c5-4105-a5ef-b7a82de44a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.205331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:26.248157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e3fd14db-e4c5-4105-a5ef-b7a82de44a4a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:26.252865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e3fd14db-e4c5-4105-a5ef-b7a82de44a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:26.310715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df7458-a35e-4860-bcc1-0a881db661a9 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.316856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.317967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.317967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.318419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.319132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.321409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.378556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 943/1915] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:26 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:26.384485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.392007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 973/1916] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:26.393913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.394353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.394671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:26.394776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.420320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036d403-bcd1-444c-9eb4-43339f54727b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.427744 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.428876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.429334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.429711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.430689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.430811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:26.432423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:26.432762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.443163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 974/1917] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:26.449176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.452147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 944/1918] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:26.456776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.465775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503761c-d83c-4d32-a27a-933767cd8f5c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.470245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f428-4c03-4819-89f4-e6924698cb1a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.472178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.473267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.474597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.474983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.476011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:26.476357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.478105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.479313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.480586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.481256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.481378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] PATH_INFO: `/v3/projects/73f8915b581d41c7ad942695857079b4/users/a4f30e673afc4dc6aa97c6a756f8e58f/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.504215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f8915b581d41c7ad942695857079b4, user_id=a4f30e673afc4dc6aa97c6a756f8e58f, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.508544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.514091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 975/1919] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:26.519458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.536365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 945/1920] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:26 2022] PUT /identity/v3/projects/73f8915b581d41c7ad942695857079b4/users/a4f30e673afc4dc6aa97c6a756f8e58f/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:26.540666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7090-0410-4807-ba23-51c1e9e5905a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.540961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.642370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.643790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.644084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.644370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.645075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.647078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.652624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3726-e359-4a29-bcf0-d475cfe5d12c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.659912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.660742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.661203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.661583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.662471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.665792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.680647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 976/1921] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:26 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:26.684776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.687644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 946/1922] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:26.689311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.703829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664515-ece0-472f-9c34-bfd095bb41ee admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.706261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:26.771514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785dd128-ec58-49fc-80b6-bd48c3fe6361 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.776864 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.777613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.777964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.778311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.779074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.781456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.796715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bacf9-d27b-4257-ac9a-6e506b71effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.797897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bacf9-d27b-4257-ac9a-6e506b71effd admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.798189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bacf9-d27b-4257-ac9a-6e506b71effd admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.798471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bacf9-d27b-4257-ac9a-6e506b71effd admin admin] PATH_INFO: `/v3/projects/73f8915b581d41c7ad942695857079b4/users/a4f30e673afc4dc6aa97c6a756f8e58f/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.803763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bacf9-d27b-4257-ac9a-6e506b71effd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f8915b581d41c7ad942695857079b4, user_id=a4f30e673afc4dc6aa97c6a756f8e58f, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.809933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 977/1923] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:26 2022] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:26.810099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bacf9-d27b-4257-ac9a-6e506b71effd admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.811393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.826900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 947/1924] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:26 2022] PUT /identity/v3/projects/73f8915b581d41c7ad942695857079b4/users/a4f30e673afc4dc6aa97c6a756f8e58f/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:26.829045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08541483-3c79-4023-9f53-d454e0a54b99 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.838060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.838362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.838682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.851567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:26.887998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] MFA Rules not processed for user `a4f30e673afc4dc6aa97c6a756f8e58f`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:26.889579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:26.933025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.934143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.934518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.935057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.935956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.938465 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:26.954390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 978/1925] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:26.961003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:26.976350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2da23-9ecf-491b-80a7-a1af3cbe2547 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:26.991373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:26.992118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:26.992386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:26.992670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:26.993504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:26.995291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.012218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 979/1926] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:27.013315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.017747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 948/1927] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:27.024262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c478-4dd6-41a4-b052-6518bb258b37 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.028886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.029113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af361fbd-62e3-40ec-8c2b-4e973ca1f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.030009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361fbd-62e3-40ec-8c2b-4e973ca1f7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.030203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:27.030300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361fbd-62e3-40ec-8c2b-4e973ca1f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.030568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af361fbd-62e3-40ec-8c2b-4e973ca1f7b2 admin admin] PATH_INFO: `/v3/projects/19fa4982f3e441deb54d1223cbcf54f2/users/724e5f41b48a436a98210b35fc5069a0/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.046695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af361fbd-62e3-40ec-8c2b-4e973ca1f7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fa4982f3e441deb54d1223cbcf54f2, user_id=724e5f41b48a436a98210b35fc5069a0, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.049421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af361fbd-62e3-40ec-8c2b-4e973ca1f7b2 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.065173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 980/1928] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:27 2022] PUT /identity/v3/projects/19fa4982f3e441deb54d1223cbcf54f2/users/724e5f41b48a436a98210b35fc5069a0/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:27.076169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.076466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.076751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.092847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6a28c-bef7-435e-ba3f-cfb7fb3c9f91 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.104245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] MFA Rules not processed for user `724e5f41b48a436a98210b35fc5069a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:27.105798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:27.150417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.151171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.151529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.151898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.175372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:27.188679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 981/1929] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:27.193143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.226713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:27.233660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.235521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.247661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 949/1930] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:27 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:27.267302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15859517-d2c8-45a0-98f7-3b84d5d08727 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.274819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.275585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.275979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.276475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.277247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.279247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.321826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 982/1931] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:27 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:27.325931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.341380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c563f-85ef-4840-bc01-ae904559148e service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.418941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.422633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.422633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.422633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.422633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.424674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.459610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 950/1932] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:27 2022] POST /identity/v3/users => generated 310 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:27.463662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.474821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac51e2-98a8-4d24-918e-9dbd8b7112bd admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.480358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.481086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.481378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.481661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.482396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.484031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.497730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 983/1933] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:27.502851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.514682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5233e-990c-4b19-9026-8fb160550f7f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.521265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.522267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.522559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.522844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] PATH_INFO: `/v3/projects/be4359441c16494a9bc9b9d3307f23a2/users/bd75c3cfcc77470fa0daeb610db73b1a/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.543614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4359441c16494a9bc9b9d3307f23a2, user_id=bd75c3cfcc77470fa0daeb610db73b1a, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.543774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.545600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:27.546736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.567957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 951/1934] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:27 2022] PUT /identity/v3/projects/be4359441c16494a9bc9b9d3307f23a2/users/bd75c3cfcc77470fa0daeb610db73b1a/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:27.569912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208f4b-ae8b-4d20-8d46-5e42ec0dbcb5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.573491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.721973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.722881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.723174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.723506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] PATH_INFO: `/v3/users/081120f99cf7483b9b41dbafbf2995d9` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.723709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1948af-aa65-438c-bbaa-7fedd2adb69f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.725149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=081120f99cf7483b9b41dbafbf2995d9)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.728324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.730217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.731359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.732249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.732370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.733612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.735412 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.751928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 952/1935] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:27.756308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.778221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3091-c61e-44cd-a77a-40f768c70e87 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:27.789441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847266b3-785b-4228-97da-719414f45991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:27.790568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847266b3-785b-4228-97da-719414f45991 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.791055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847266b3-785b-4228-97da-719414f45991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.792876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847266b3-785b-4228-97da-719414f45991 admin admin] PATH_INFO: `/v3/projects/be4359441c16494a9bc9b9d3307f23a2/users/bd75c3cfcc77470fa0daeb610db73b1a/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.795975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847266b3-785b-4228-97da-719414f45991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4359441c16494a9bc9b9d3307f23a2, user_id=bd75c3cfcc77470fa0daeb610db73b1a, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:27.799961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847266b3-785b-4228-97da-719414f45991 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:27.828118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 953/1936] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:27 2022] PUT /identity/v3/projects/be4359441c16494a9bc9b9d3307f23a2/users/bd75c3cfcc77470fa0daeb610db73b1a/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:27.840048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff966d8b-c71d-4f08-abd5-04dd70344bbb None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:27.840416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff966d8b-c71d-4f08-abd5-04dd70344bbb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:27.840696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff966d8b-c71d-4f08-abd5-04dd70344bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:27.841084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081120f99cf7483b9b41dbafbf2995d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:27.859964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081120f99cf7483b9b41dbafbf2995d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:27.890170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081120f99cf7483b9b41dbafbf2995d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:27.891382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081120f99cf7483b9b41dbafbf2995d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:27.892570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081120f99cf7483b9b41dbafbf2995d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:27.914787 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:27.916789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ff966d8b-c71d-4f08-abd5-04dd70344bbb None None] MFA Rules not processed for user `bd75c3cfcc77470fa0daeb610db73b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:27.918751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ff966d8b-c71d-4f08-abd5-04dd70344bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:27.935902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 984/1937] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:27 2022] DELETE /identity/v3/users/081120f99cf7483b9b41dbafbf2995d9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:27.937142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:27.945629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:27.958314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:28.005553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 954/1938] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:27 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:28.007180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.007626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.008082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.029293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:28.029990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894e3a-846d-4f0a-a549-00b82324dc6d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.030493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.039495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.040591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.041499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.042226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.045027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.099043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 955/1939] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:28.100783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.103302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.116044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4c740-2adc-430c-8735-51c25499eae1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.120277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.120644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.121001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.121362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.122956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.124521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.136789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 985/1940] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:28.138105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.139506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.215427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f045ec7-d6b2-46a9-b129-2c48069a0211 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.219481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.220389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.220618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.220904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.221351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.223756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.240522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.242508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.243375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 956/1941] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:28 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:28.256377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 986/1942] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:28.536727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.547643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5a17-efef-49dd-a028-b872f29e6efa service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.563334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.564066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.564351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.564636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.567202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.623532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.625462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.641953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb5c02-c2d1-4443-b833-2c70b67bf6d5 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.646821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.647813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.648345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.649125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] PATH_INFO: `/v3/projects/b0dfb190f570462fb9999f57272d5c4b` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.651187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0dfb190f570462fb9999f57272d5c4b)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.653731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.658298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.659798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.666518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:28.685848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 957/1943] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:28 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:28.725568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:28.733754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0dfb190f570462fb9999f57272d5c4b', 'request_id': 'req-f8b455e9-7ec7-440f-a5d1-79334338aa4d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:28.745194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0dfb190f570462fb9999f57272d5c4b', 'request_id': 'req-f8b455e9-7ec7-440f-a5d1-79334338aa4d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:28.752210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0dfb190f570462fb9999f57272d5c4b', 'request_id': 'req-f8b455e9-7ec7-440f-a5d1-79334338aa4d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:28.778108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] The token cache is being invalidate because project b0dfb190f570462fb9999f57272d5c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:28.779563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:28.785033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f8b455e9-7ec7-440f-a5d1-79334338aa4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:28.788863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 987/1944] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:28 2022] DELETE /identity/v3/projects/b0dfb190f570462fb9999f57272d5c4b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:28.793093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.819322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea4f4-d061-4fc7-8af1-16e3e1205b44 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.918288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.919191 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.919484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.920385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] PATH_INFO: `/v3/users/2aa8cfe09ed64297844eec31723f6adc` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.922267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa8cfe09ed64297844eec31723f6adc)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.925162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:29.033910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa8cfe09ed64297844eec31723f6adc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:29.094305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa8cfe09ed64297844eec31723f6adc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:29.133255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa8cfe09ed64297844eec31723f6adc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:29.134116 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa8cfe09ed64297844eec31723f6adc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:29.134911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa8cfe09ed64297844eec31723f6adc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:29.197515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 958/1945] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:28 2022] DELETE /identity/v3/users/2aa8cfe09ed64297844eec31723f6adc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:29.296389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf948d-afde-43de-a7c3-2f9d837a8156 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:29.297904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf948d-afde-43de-a7c3-2f9d837a8156 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:29.298399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf948d-afde-43de-a7c3-2f9d837a8156 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:29.300384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 988/1946] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:28:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:28:29.314383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:29.316396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:29.341840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:29.342416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:29.342867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:29.397233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:29.398641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:29.513245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530a0b2-46ab-41a3-96bd-42e04cdf1142 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:29.535629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:29.537270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:29.537565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:29.537872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:29.541130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:29.583441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 989/1947] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:29.621102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:29.670487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:29.672874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:29.711126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 959/1948] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:30.022605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:30.024687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:30.191645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e70b62-47f5-4f50-9260-8e76039a1a86 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:30.198257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:30.199223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:30.199576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:30.200091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] PATH_INFO: `/v3/projects/2a7a2a37b7a042a0986cee66237f3e70` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:30.201844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7a2a37b7a042a0986cee66237f3e70)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:30.204768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:30.304750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7a2a37b7a042a0986cee66237f3e70', 'request_id': 'req-220e1ede-c361-437c-bd0d-7be383fab081'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:30.306350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:30.310418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:30.324121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7a2a37b7a042a0986cee66237f3e70', 'request_id': 'req-220e1ede-c361-437c-bd0d-7be383fab081'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:30.334061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7a2a37b7a042a0986cee66237f3e70', 'request_id': 'req-220e1ede-c361-437c-bd0d-7be383fab081'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:30.336233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:30.356263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563b4b-b4c1-4f85-9b88-6aedb0e14587 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:30.362515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] The token cache is being invalidate because project 2a7a2a37b7a042a0986cee66237f3e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:30.363057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:30.366703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-220e1ede-c361-437c-bd0d-7be383fab081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:30.368963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 990/1949] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:30 2022] DELETE /identity/v3/projects/2a7a2a37b7a042a0986cee66237f3e70 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:30.375992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:30.376738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:30.377335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:30.436912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:30.439385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:30.465306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:30.466195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:30.466568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:30.466958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:30.470357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:30.492155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:30.496140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a965297-e27a-4f27-8f50-75419b9fc640 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:30.529466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 960/1950] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:30.590609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 991/1951] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:30.600082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:30.600514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:30.600997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:30.642883 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:30.644700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:30.655280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 961/1952] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:30.660529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:30.676555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a7ba-fc4a-4fef-90ae-7ff99b64b886 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:30.698211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:30.700307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:30.702772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:30.702772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:30.703671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:30.705553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:30.709448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:30.743491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 992/1953] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:28:30.746817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:30.761249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9f664-2fd1-41f3-8462-87640f10636e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:30.774211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:30.775321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:30.776547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:30.777056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:30.780056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:30.782497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:30.837097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:30.839187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:30.878826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 962/1954] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:30 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:30.882081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c71552-89ff-45ed-ba16-190222b3eb99 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:30.886738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.003016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.004063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.004355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.004878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] PATH_INFO: `/v3/users/d0582dbe11894a0fbf151c3527955bae` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.006992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0582dbe11894a0fbf151c3527955bae)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.009077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.106944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56629d-fce9-4a87-9055-6deb9bbde1e0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.108528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0582dbe11894a0fbf151c3527955bae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:31.117734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.118474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.118891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.119177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.120045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.122032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.124474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0582dbe11894a0fbf151c3527955bae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:31.151914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0582dbe11894a0fbf151c3527955bae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:31.153734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0582dbe11894a0fbf151c3527955bae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:31.155020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0599f304-4333-437c-bec5-dab5de4c3b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0582dbe11894a0fbf151c3527955bae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:31.164277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 963/1955] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:30 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:31.168176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.170232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:31.198704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a34c-c7c5-4afb-b358-413cb838b14b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.200128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:31.217665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.218372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.218682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.218972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.219729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.221400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.229822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 993/1956] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:30 2022] DELETE /identity/v3/users/d0582dbe11894a0fbf151c3527955bae => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:31.233308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.234811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.235723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.251916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 964/1957] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:31.253341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.267465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:31.278985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1de6b-b5e9-475d-bae7-67c34d3001f4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.293238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:31.297778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:31.409979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.410923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.411427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.411827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.413034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.418416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.435060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 994/1958] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:31.441589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 965/1959] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:31.443532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.457122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69740d50-3faf-4989-8a8c-d8c1133e742c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.471944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13673-beda-40d8-bfde-a49f4dc72f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.473181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13673-beda-40d8-bfde-a49f4dc72f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.473613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13673-beda-40d8-bfde-a49f4dc72f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.473951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13673-beda-40d8-bfde-a49f4dc72f43 admin admin] PATH_INFO: `/v3/projects/f579ee6b64bb4585b4ec336797b618a5/users/b555daad2a7f4573b3a77b0cf0de53c7/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.493604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13673-beda-40d8-bfde-a49f4dc72f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f579ee6b64bb4585b4ec336797b618a5, user_id=b555daad2a7f4573b3a77b0cf0de53c7, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.497186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13673-beda-40d8-bfde-a49f4dc72f43 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.524770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 995/1960] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:31 2022] PUT /identity/v3/projects/f579ee6b64bb4585b4ec336797b618a5/users/b555daad2a7f4573b3a77b0cf0de53c7/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:31.526473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.533549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:31.534709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.535012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.535297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.570290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] MFA Rules not processed for user `b555daad2a7f4573b3a77b0cf0de53c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:31.571614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:31.621208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a025d-09dd-4866-aa72-305752a25418 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.694962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 996/1961] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:31.701762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.777695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.787138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.787436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.787719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.806145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e560c-84fd-48f7-bbe3-c7b5b7c0cc67 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.813470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.814470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.815098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.815574 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.816611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.819074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.829993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:31.863449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 997/1962] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:31 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:31.864623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.878456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.880296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.908894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 966/1963] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:31.972083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718f09-72ad-4c96-9981-3abb7f674807 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.978212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.979163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.979463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.980248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.981034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.983734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.010710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 998/1964] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:31 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:32.013909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.027044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92e5b4-cc50-4e1e-8484-e44762febb67 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.033328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.034465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.034686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.034971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.036451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.038056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.040055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:32.092685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 967/1965] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:32.097248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.111314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343e4b3-c58d-48fe-a939-119199d3fd7e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.117740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.118650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.118935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.119261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] PATH_INFO: `/v3/projects/6a6e612ad9554a3cb2fa21d6dec30720/users/4fb9d00c33264a90bf6858407c0e90ef/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.146215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6e612ad9554a3cb2fa21d6dec30720, user_id=4fb9d00c33264a90bf6858407c0e90ef, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.155898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.182339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 999/1966] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:32 2022] PUT /identity/v3/projects/6a6e612ad9554a3cb2fa21d6dec30720/users/4fb9d00c33264a90bf6858407c0e90ef/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:32.186078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.200177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94d0a6-0769-4a83-9514-54c400dc7500 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.296682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65975d1e-10f9-4172-a1ba-ca1f294e0cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.298483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975d1e-10f9-4172-a1ba-ca1f294e0cfc admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.298936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975d1e-10f9-4172-a1ba-ca1f294e0cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.299388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975d1e-10f9-4172-a1ba-ca1f294e0cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.301005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65975d1e-10f9-4172-a1ba-ca1f294e0cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.306328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65975d1e-10f9-4172-a1ba-ca1f294e0cfc admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.332030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 968/1967] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:32.336926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.357979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bf298-a52a-44f4-b9ec-d340e023dd7e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.366297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.367619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.367929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.368313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] PATH_INFO: `/v3/projects/6a6e612ad9554a3cb2fa21d6dec30720/users/4fb9d00c33264a90bf6858407c0e90ef/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.371338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6e612ad9554a3cb2fa21d6dec30720, user_id=4fb9d00c33264a90bf6858407c0e90ef, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.374786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.398402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1000/1968] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:32 2022] PUT /identity/v3/projects/6a6e612ad9554a3cb2fa21d6dec30720/users/4fb9d00c33264a90bf6858407c0e90ef/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:32.399668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.400004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.400288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.458326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] MFA Rules not processed for user `4fb9d00c33264a90bf6858407c0e90ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:32.459568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:32.555272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 969/1969] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:32.572995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.575638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:32.599788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.603180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:32.677240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca1886-4bca-4220-b495-074331a5cc3c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.681847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.682576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.682967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.683363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.694100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.695751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.698795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443f6f-9447-43d9-9ed4-f3cb30cc26fb None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.704113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.705676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.706380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1001/1970] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:32.716086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.716626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] PATH_INFO: `/v3/projects/1cb9e9592a654c97bbf432a648b2732b` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.720701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb9e9592a654c97bbf432a648b2732b)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.722745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.751330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:32.807924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.810942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb9e9592a654c97bbf432a648b2732b', 'request_id': 'req-5a305025-c2d8-46a1-99f2-a795ed22b142'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:32.816313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1c6df-0f5f-4ed4-a06e-c9c5c6516a77 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.818954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb9e9592a654c97bbf432a648b2732b', 'request_id': 'req-5a305025-c2d8-46a1-99f2-a795ed22b142'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:32.828136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb9e9592a654c97bbf432a648b2732b', 'request_id': 'req-5a305025-c2d8-46a1-99f2-a795ed22b142'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:32.848169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] The token cache is being invalidate because project 1cb9e9592a654c97bbf432a648b2732b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:32.849138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:32.850250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:32.855953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 970/1971] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:32 2022] DELETE /identity/v3/projects/1cb9e9592a654c97bbf432a648b2732b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:32.869535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.873796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:32.899599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:32.913106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.913775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.914151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.914822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.917162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:33.058305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a305025-c2d8-46a1-99f2-a795ed22b142 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:33.073452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:33.075270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:33.084292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:33.085214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:33.087373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:33.088524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] PATH_INFO: `/v3/users/a4f30e673afc4dc6aa97c6a756f8e58f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:33.089817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1002/1972] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:33.091091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f30e673afc4dc6aa97c6a756f8e58f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:33.093803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:33.216278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f30e673afc4dc6aa97c6a756f8e58f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:33.231142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f30e673afc4dc6aa97c6a756f8e58f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:33.245438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f30e673afc4dc6aa97c6a756f8e58f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:33.247431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f30e673afc4dc6aa97c6a756f8e58f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:33.248227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b62feec3-97ef-47cb-b7b6-3bcb413a6d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f30e673afc4dc6aa97c6a756f8e58f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:33.319161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 971/1973] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:32 2022] DELETE /identity/v3/users/a4f30e673afc4dc6aa97c6a756f8e58f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:33.960887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:33.972419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98e71-f07f-46a6-befd-7dc3d8f3b96b service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.034510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.035508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.036450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.036983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] PATH_INFO: `/v3/projects/73f8915b581d41c7ad942695857079b4` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.037968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f8915b581d41c7ad942695857079b4)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.039893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.104718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f8915b581d41c7ad942695857079b4', 'request_id': 'req-8ade8889-7bdd-4999-84e8-dfd133497960'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.112091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f8915b581d41c7ad942695857079b4', 'request_id': 'req-8ade8889-7bdd-4999-84e8-dfd133497960'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.119493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f8915b581d41c7ad942695857079b4', 'request_id': 'req-8ade8889-7bdd-4999-84e8-dfd133497960'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.139204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] The token cache is being invalidate because project 73f8915b581d41c7ad942695857079b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:34.139502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.140163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8ade8889-7bdd-4999-84e8-dfd133497960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.141943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1003/1974] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:33 2022] DELETE /identity/v3/projects/73f8915b581d41c7ad942695857079b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:34.147336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.147821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.147932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.166088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:34.167302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.190014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:34.234500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 972/1975] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:34.243313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.243594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.243910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.264692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:34.266049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.275973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1004/1976] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:34.279676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.290691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac2423-a0ee-4f58-b5df-f20a688447ae None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.295602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.296326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.296743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.297040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.297781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:34.298095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.299700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.319976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 973/1977] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:34.322057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.332033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb9ec8-2448-49b4-82f6-0b5d44c52886 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.337595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.338258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.338546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.338825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.339529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.341517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.363202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:34.378103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.378959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1005/1978] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:34.392665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bf5bd-af28-4cc4-996b-df7b4aeeee9e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.442834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.444991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.459423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.460142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.460435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.460722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.461420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.463431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.487555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 974/1979] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:34.488639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.499522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c679ff-517f-4a77-996c-d0eb8b88fea5 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.505140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.505810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.506100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.506389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.507208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.508752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.511645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98b3b5-934c-4be1-917c-e2e492e25e74 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.516429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.517324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.517615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.517902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] PATH_INFO: `/v3/users/92b15e01c89949fc965263718c79cb73` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.518706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 975/1980] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:34.519140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b15e01c89949fc965263718c79cb73)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.521455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.522528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.531942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f6fd-a118-412b-9ccd-220d9df8fc40 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.537329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.537989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.538403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.538818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.539613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.541738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.554951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 976/1981] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:34.559810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.570559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4d442-9e99-449f-b66b-bbdafef63447 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.575961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d124dc-e9f1-4c9b-bb7a-f4196b59ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.576848 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d124dc-e9f1-4c9b-bb7a-f4196b59ffbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.577138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d124dc-e9f1-4c9b-bb7a-f4196b59ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.577404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d124dc-e9f1-4c9b-bb7a-f4196b59ffbe admin admin] PATH_INFO: `/v3/projects/f5b31530e7c946b6be6352bdb2b56b47/users/94e35f09ec584525987f134c1e3d669a/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.578229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b15e01c89949fc965263718c79cb73'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.589162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b15e01c89949fc965263718c79cb73'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.594312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d124dc-e9f1-4c9b-bb7a-f4196b59ffbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b31530e7c946b6be6352bdb2b56b47, user_id=94e35f09ec584525987f134c1e3d669a, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.597724 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b15e01c89949fc965263718c79cb73'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.598030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d124dc-e9f1-4c9b-bb7a-f4196b59ffbe admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.599163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b15e01c89949fc965263718c79cb73'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.602929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-e5da0bfd-510a-47ae-90e6-9d2344a8357e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b15e01c89949fc965263718c79cb73'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:34.619948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 977/1982] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:34 2022] PUT /identity/v3/projects/f5b31530e7c946b6be6352bdb2b56b47/users/94e35f09ec584525987f134c1e3d669a/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:34.634345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.636229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.636857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.644492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1006/1983] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:34 2022] DELETE /identity/v3/users/92b15e01c89949fc965263718c79cb73 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:34.648119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.648644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.649030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.682603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] MFA Rules not processed for user `94e35f09ec584525987f134c1e3d669a`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:34.684067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.694624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:34.695969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.770817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:34.799111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 978/1984] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:34.804555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.806980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.808287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1007/1985] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:34.821813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.825397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.841423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6f7db-22f2-4771-bc19-7b8095f11852 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.849320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.850225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.851002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.851002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.851901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.854317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.891475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 979/1986] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:34.897386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.900412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:34.993151 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c3854-9c78-4772-86d7-8f44ce0a6aac None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.058239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548c08-a4f6-4cf0-8c4d-717ff9a90a62 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.074793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.077417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.078370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.079449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.080382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.082867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.103208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.104038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.104389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.104766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.118633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 980/1987] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:35.119524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.121215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.121426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.136502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457b3e-c261-496a-8c86-3d346d3abc64 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.141496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1008/1988] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:35.145970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.146348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.146770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.147133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.147981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.150099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.167010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 981/1989] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:35.168145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.183050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.185822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:35.188085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5484812-c4ca-41f6-b79b-8e49970d5b73 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.193913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.194878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.195175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.195456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] PATH_INFO: `/v3/projects/88b72d282e3143ea921ac35f0a622bf5/users/a587b6b1a4184532b309c6ffb417991e/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.205673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e02430-1848-4482-867f-b58a8d748745 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.213533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.215024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.215551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.215942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] PATH_INFO: `/v3/users/724e5f41b48a436a98210b35fc5069a0` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.217989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724e5f41b48a436a98210b35fc5069a0)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.220716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b72d282e3143ea921ac35f0a622bf5, user_id=a587b6b1a4184532b309c6ffb417991e, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.221975 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.224711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.257730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1009/1990] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:35 2022] PUT /identity/v3/projects/88b72d282e3143ea921ac35f0a622bf5/users/a587b6b1a4184532b309c6ffb417991e/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:35.261687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.312446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724e5f41b48a436a98210b35fc5069a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:35.322536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724e5f41b48a436a98210b35fc5069a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:35.332869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724e5f41b48a436a98210b35fc5069a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:35.335448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724e5f41b48a436a98210b35fc5069a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:35.346513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0c27b6a-1468-4b5c-8d06-dd25400a81d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724e5f41b48a436a98210b35fc5069a0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:35.376384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 982/1991] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:35 2022] DELETE /identity/v3/users/724e5f41b48a436a98210b35fc5069a0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:35.383660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.384165 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.384562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.389327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e159a-bf6e-4e58-b7f3-d4f9226df3c0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.409875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:35.412766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:35.428679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:35.480836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.481606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.481892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.482620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.482892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.485458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.490585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:35.506410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1010/1992] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:35.507742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.509801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:35.513157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 983/1993] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:35.523197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc43138-9037-4e39-9c96-56d8ac48d178 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.528903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f1e3-c808-44c7-b117-32b9094f1a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.529940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f1e3-c808-44c7-b117-32b9094f1a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.530326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f1e3-c808-44c7-b117-32b9094f1a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.530710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f1e3-c808-44c7-b117-32b9094f1a69 admin admin] PATH_INFO: `/v3/projects/88b72d282e3143ea921ac35f0a622bf5/users/a587b6b1a4184532b309c6ffb417991e/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.533442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f1e3-c808-44c7-b117-32b9094f1a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b72d282e3143ea921ac35f0a622bf5, user_id=a587b6b1a4184532b309c6ffb417991e, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.536247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f1e3-c808-44c7-b117-32b9094f1a69 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.558954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.561368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:35.569952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1011/1994] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:35 2022] PUT /identity/v3/projects/88b72d282e3143ea921ac35f0a622bf5/users/a587b6b1a4184532b309c6ffb417991e/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:35.590565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.590565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.590565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.682135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] MFA Rules not processed for user `a587b6b1a4184532b309c6ffb417991e`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:35.684403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:35.739140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cdd2a-efaf-4865-a693-3465c8df1cbc None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.847816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1012/1995] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:35.850859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.853474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:35.871444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.874765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.875068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.876889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.939614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ecb82-f74b-41f7-93fc-24c448d2a8c1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:35.945921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:35.946789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:35.947079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:35.947361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] PATH_INFO: `/v3/projects/973c33f5529f44228683df726dd4ba4f` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:35.949409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973c33f5529f44228683df726dd4ba4f)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.951345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.959109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:35.961033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:35.975616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 984/1996] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:35.976923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:35.978637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:36.014087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973c33f5529f44228683df726dd4ba4f', 'request_id': 'req-23713b46-4e70-4b19-8cab-3d0ee1095068'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.017023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:36.029703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973c33f5529f44228683df726dd4ba4f', 'request_id': 'req-23713b46-4e70-4b19-8cab-3d0ee1095068'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.044503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973c33f5529f44228683df726dd4ba4f', 'request_id': 'req-23713b46-4e70-4b19-8cab-3d0ee1095068'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.062185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:36.072074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] The token cache is being invalidate because project 973c33f5529f44228683df726dd4ba4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:36.072962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.076255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.079592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1013/1997] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:35 2022] DELETE /identity/v3/projects/973c33f5529f44228683df726dd4ba4f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:36.080022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217937-75ec-45ef-b046-aa954738cbef service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:36.085281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:36.089000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:36.199188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:36.199917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:36.200210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:36.200490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:36.202514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:36.231327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23713b46-4e70-4b19-8cab-3d0ee1095068 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:36.241180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:36.242143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:36.242511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:36.242853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] PATH_INFO: `/v3/users/1724f1cc32424af1aa2d1f3cdc1fcc7a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:36.244194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1724f1cc32424af1aa2d1f3cdc1fcc7a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:36.246275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:36.351648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:36.353318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:36.366712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1724f1cc32424af1aa2d1f3cdc1fcc7a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.377961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1724f1cc32424af1aa2d1f3cdc1fcc7a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.378355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 985/1998] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:36.388203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1724f1cc32424af1aa2d1f3cdc1fcc7a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.389058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1724f1cc32424af1aa2d1f3cdc1fcc7a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.389918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1724f1cc32424af1aa2d1f3cdc1fcc7a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:36.438466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1014/1999] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:36 2022] DELETE /identity/v3/users/1724f1cc32424af1aa2d1f3cdc1fcc7a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:36.983509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:36.984770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:37.010373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388625-640e-4981-8ed0-b92222a65593 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:37.126232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:37.127657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:37.128005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:37.128290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] PATH_INFO: `/v3/projects/19fa4982f3e441deb54d1223cbcf54f2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:37.131302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fa4982f3e441deb54d1223cbcf54f2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:37.133522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:37.227954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:37.228551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:37.230650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:37.255867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03b463-d5d2-48c9-8c3a-9ba2b3410c7b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:37.273697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fa4982f3e441deb54d1223cbcf54f2', 'request_id': 'req-1b3a999b-733d-474d-a492-f389b39b2903'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.291842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fa4982f3e441deb54d1223cbcf54f2', 'request_id': 'req-1b3a999b-733d-474d-a492-f389b39b2903'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.300254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fa4982f3e441deb54d1223cbcf54f2', 'request_id': 'req-1b3a999b-733d-474d-a492-f389b39b2903'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.318598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] The token cache is being invalidate because project 19fa4982f3e441deb54d1223cbcf54f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:37.318904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.319626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.321601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 986/2000] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:36 2022] DELETE /identity/v3/projects/19fa4982f3e441deb54d1223cbcf54f2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:37.325269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:37.327733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:37.375549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:37.376707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:37.377215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:37.378120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] PATH_INFO: `/v3/projects/548130c04c05441398a2ba4faacff27a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:37.379650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=548130c04c05441398a2ba4faacff27a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:37.381917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:37.415797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:37.440136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a999b-733d-474d-a492-f389b39b2903 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:37.462143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548130c04c05441398a2ba4faacff27a', 'request_id': 'req-768a3c65-dfdd-401a-815a-740bbd13730a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.477162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548130c04c05441398a2ba4faacff27a', 'request_id': 'req-768a3c65-dfdd-401a-815a-740bbd13730a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.486343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548130c04c05441398a2ba4faacff27a', 'request_id': 'req-768a3c65-dfdd-401a-815a-740bbd13730a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.506608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] The token cache is being invalidate because project 548130c04c05441398a2ba4faacff27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:37.507179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.508467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.511984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1015/2001] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:37 2022] DELETE /identity/v3/projects/548130c04c05441398a2ba4faacff27a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:37.523376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:37.526972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:37.559466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:37.559634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:37.560498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:37.560810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] PATH_INFO: `/v3/users/bd75c3cfcc77470fa0daeb610db73b1a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:37.565784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd75c3cfcc77470fa0daeb610db73b1a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:37.568591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:37.635176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd75c3cfcc77470fa0daeb610db73b1a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.641856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a3c65-dfdd-401a-815a-740bbd13730a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:37.646948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd75c3cfcc77470fa0daeb610db73b1a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.650485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:37.650485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:37.650973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:37.651303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] PATH_INFO: `/v3/users/7d08858a0e0b4171bced412b4a840d3e` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:37.653067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d08858a0e0b4171bced412b4a840d3e)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:37.655406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:37.656684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd75c3cfcc77470fa0daeb610db73b1a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.657971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd75c3cfcc77470fa0daeb610db73b1a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.658615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd75c3cfcc77470fa0daeb610db73b1a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.668033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:37.684781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 987/2002] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:37 2022] DELETE /identity/v3/users/bd75c3cfcc77470fa0daeb610db73b1a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:37.711190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d08858a0e0b4171bced412b4a840d3e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.720578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d08858a0e0b4171bced412b4a840d3e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.731695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d08858a0e0b4171bced412b4a840d3e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.732896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d08858a0e0b4171bced412b4a840d3e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.733815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d08858a0e0b4171bced412b4a840d3e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:37.762324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1016/2003] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:37 2022] DELETE /identity/v3/users/7d08858a0e0b4171bced412b4a840d3e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:37.991346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:37.993043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.009778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.012216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.090036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:38.106040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad591d6-3613-40d6-bf1a-5757fd73095f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.145896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4ccf9-4d66-4c0a-b389-53ff1e94c84f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.153005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.154129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.154517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.155377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] PATH_INFO: `/v3/projects/be4359441c16494a9bc9b9d3307f23a2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.156797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4359441c16494a9bc9b9d3307f23a2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.159656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.184837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.186325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.186878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.187262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.190109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.256669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4359441c16494a9bc9b9d3307f23a2', 'request_id': 'req-f76b3b6b-464f-4f1f-b391-f29a2821cffd'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.264452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4359441c16494a9bc9b9d3307f23a2', 'request_id': 'req-f76b3b6b-464f-4f1f-b391-f29a2821cffd'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.272837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4359441c16494a9bc9b9d3307f23a2', 'request_id': 'req-f76b3b6b-464f-4f1f-b391-f29a2821cffd'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.299448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] The token cache is being invalidate because project be4359441c16494a9bc9b9d3307f23a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:38.299808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.300770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.303042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.303525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1017/2004] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:38 2022] DELETE /identity/v3/projects/be4359441c16494a9bc9b9d3307f23a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:38.304245 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.305809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbcad6-b761-46f6-bed4-f294d418974f service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.309378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.323635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 988/2005] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:38.335279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9701c-1a51-487f-98de-78dc4ba0de88 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.337057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9701c-1a51-487f-98de-78dc4ba0de88 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.337560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9701c-1a51-487f-98de-78dc4ba0de88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.382815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b3b6b-464f-4f1f-b391-f29a2821cffd admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.386209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a5f9701c-1a51-487f-98de-78dc4ba0de88 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:38.387526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a5f9701c-1a51-487f-98de-78dc4ba0de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.387759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.389405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.389405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.389405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] PATH_INFO: `/v3/projects/7a14704614fe459185b8f0927e8f73e0` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.390584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a14704614fe459185b8f0927e8f73e0)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.392776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.406530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 989/2006] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:38.414185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.415102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.415607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.447566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:38.449102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.476379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a14704614fe459185b8f0927e8f73e0', 'request_id': 'req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.500813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a14704614fe459185b8f0927e8f73e0', 'request_id': 'req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.507066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:38.514892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a14704614fe459185b8f0927e8f73e0', 'request_id': 'req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.535438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:38.538263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] The token cache is being invalidate because project 7a14704614fe459185b8f0927e8f73e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:38.538767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.541395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5a0801a-8850-413d-a4ef-7b4aa8ba39d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:38.543973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1018/2007] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:38 2022] DELETE /identity/v3/projects/7a14704614fe459185b8f0927e8f73e0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:38.550500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9d48-354c-4964-a950-b44187ad2851 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.551123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9d48-354c-4964-a950-b44187ad2851 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.552754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9d48-354c-4964-a950-b44187ad2851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.582355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 990/2008] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:38.584429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.601385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ef6f9d48-354c-4964-a950-b44187ad2851 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:38.602992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ef6f9d48-354c-4964-a950-b44187ad2851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.620044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1019/2009] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:38.627915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.628430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.628957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.642126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e9b30-1c60-4bcd-afe2-cf3d3ebf14b3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.662174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:38.664569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:38.674498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.675194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.675485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.675768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.677111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:38.677422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.680172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1020/2010] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:38.681882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.685688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.693354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab37ffb-b14a-46a9-853f-d425ba065449 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.699252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.700379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.700673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.700957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.702463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:38.702795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.704447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.716697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 991/2011] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:38.722102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.722464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1021/2012] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:38.728097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.743639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295553ca-b8d0-4ecb-bfce-0969c3d32134 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.747101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c48bc6-ee65-4ed8-a24d-a97141cc8cb3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.753121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.753799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.754085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.754254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.754623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.755080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.757154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.757939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.758404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.758788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.760059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.765703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.809966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1022/2013] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:38.814395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.825028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 992/2014] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:38.829050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:38.934908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685728d0-e582-46dd-9dc6-9dc1c6778243 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.954703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b84c9c-eed1-4edc-8c7a-5a72ae108de0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:38.961118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.962132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.962651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.963140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.964082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.964662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:38.965407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:38.965700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:38.965990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:38.966740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:38.967779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:38.969485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.003444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 993/2015] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:39.005716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.009086 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.009211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1023/2016] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:38 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:39.009981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.021299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0a1d-fc6b-4b4c-84d7-3a526b121e87 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.025367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046588c-6b64-428f-afb9-c4ada0a18a70 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.026410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.027094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.027387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.027676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.028472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.030416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.032433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.033703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.034355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.034845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] PATH_INFO: `/v3/users/b555daad2a7f4573b3a77b0cf0de53c7` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.037072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b555daad2a7f4573b3a77b0cf0de53c7)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.043006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1024/2017] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:39.044084 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.048791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.059258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d574-7752-44df-a610-5813b352a283 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.064828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.065656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.066017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.066375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.067768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.069048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.080471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1025/2018] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:39.081330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.096977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc3f59-dedd-4298-af2a-18776e558f29 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.103896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.104805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.105451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.105746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.106495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.108713 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.119383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b555daad2a7f4573b3a77b0cf0de53c7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:39.132258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1026/2019] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:39.132258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.135536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b555daad2a7f4573b3a77b0cf0de53c7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:39.141351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c800b-f8ff-4582-be38-04bc2bd1f6ac admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.147404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.147611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b555daad2a7f4573b3a77b0cf0de53c7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:39.148115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.148407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.148689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.148874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b555daad2a7f4573b3a77b0cf0de53c7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:39.149426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.149729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b555daad2a7f4573b3a77b0cf0de53c7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:39.151282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.167076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1027/2020] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:39.167076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.167367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.181458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 994/2021] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:39 2022] DELETE /identity/v3/users/b555daad2a7f4573b3a77b0cf0de53c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:39.181799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a95c82-98b0-496a-aab6-db254d8462f7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.182375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.184308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.204118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:39.250865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:39.265563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5157c-8618-4d60-a801-9475136e7607 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.268533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861ce4-6d11-446e-a817-6d008da1cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.270296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861ce4-6d11-446e-a817-6d008da1cba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.270785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861ce4-6d11-446e-a817-6d008da1cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.271298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861ce4-6d11-446e-a817-6d008da1cba6 admin admin] PATH_INFO: `/v3/projects/b8b58323fffe45eab9bc3da82ed25e6e/users/3bf0ec6210de41f59e42a294adc8b9bc/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.276704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b431d-9869-41d1-9ea9-bde81e802485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.277622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b431d-9869-41d1-9ea9-bde81e802485 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.277915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b431d-9869-41d1-9ea9-bde81e802485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.278547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b431d-9869-41d1-9ea9-bde81e802485 admin admin] PATH_INFO: `/v3/projects/7492df6834fc4068b27f3fd2ac4c3900/users/9003ed19b96947a799d21a1cbd5b6177/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.293318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861ce4-6d11-446e-a817-6d008da1cba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b58323fffe45eab9bc3da82ed25e6e, user_id=3bf0ec6210de41f59e42a294adc8b9bc, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.296490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861ce4-6d11-446e-a817-6d008da1cba6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.301767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b431d-9869-41d1-9ea9-bde81e802485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7492df6834fc4068b27f3fd2ac4c3900, user_id=9003ed19b96947a799d21a1cbd5b6177, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.306900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b431d-9869-41d1-9ea9-bde81e802485 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.331912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1028/2022] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:39 2022] PUT /identity/v3/projects/b8b58323fffe45eab9bc3da82ed25e6e/users/3bf0ec6210de41f59e42a294adc8b9bc/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:39.331912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02006083-7006-420b-9500-12f6b732e826 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.331912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02006083-7006-420b-9500-12f6b732e826 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.331912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02006083-7006-420b-9500-12f6b732e826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.332403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 995/2023] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:39 2022] PUT /identity/v3/projects/7492df6834fc4068b27f3fd2ac4c3900/users/9003ed19b96947a799d21a1cbd5b6177/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:39.337616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.337616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.337935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.360703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-02006083-7006-420b-9500-12f6b732e826 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:39.362562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-02006083-7006-420b-9500-12f6b732e826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.380960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] MFA Rules not processed for user `3bf0ec6210de41f59e42a294adc8b9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:39.382109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.441744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1029/2024] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:39.445234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.445234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.445234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.468014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 996/2025] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:39.469513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.471205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.486813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] MFA Rules not processed for user `9003ed19b96947a799d21a1cbd5b6177`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:39.488103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.555372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f12a-270d-449e-b2ef-fa1639094181 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.559741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.560464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.561104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.561405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.573785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.575260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.575645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1030/2026] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:39.580956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.588867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 997/2027] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:39.593525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1992c7-c5e7-4a33-96e6-a01136ecf17e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.599252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.600065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.600360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.600783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.601629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.603421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.605301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.606782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:39.670648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1031/2028] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:39 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:39.671467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.695708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:39.751564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3cb4a-b298-4791-958c-b432da744f2c service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.768156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:39.836213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab075f-e2c1-4b4d-9bc7-7a73ab643f8f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.851027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.853009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.854457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.854711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.855801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.861642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:39.867666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.868429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.868822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.869121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.933517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1032/2029] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:39 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:39.934966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:39.975385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd8a96-e9f6-43a7-97b9-ed996713679e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:39.991179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:39.991901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:39.992188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:39.992483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:39.994376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:39.996925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.055416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1033/2030] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:40.056731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.067459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.069939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.073700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ff2c-091d-4c95-98f2-fb413f5168e8 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.080989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db871004-f19a-4feb-acd0-c8b46c933938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.081801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db871004-f19a-4feb-acd0-c8b46c933938 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.082189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db871004-f19a-4feb-acd0-c8b46c933938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.083191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db871004-f19a-4feb-acd0-c8b46c933938 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.084064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db871004-f19a-4feb-acd0-c8b46c933938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.085793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db871004-f19a-4feb-acd0-c8b46c933938 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.099822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 998/2031] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:40.104607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1034/2032] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:40.105722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.126374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673f4f3-21d4-4ab2-b266-3070edea2ffa service glance] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.135557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.137960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.139240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.140262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] PATH_INFO: `/v3/projects/6727424e33804148a87e26602f702a0c/users/7930b5f3583a4cb5abdc96cb2c60584f/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.185449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6727424e33804148a87e26602f702a0c, user_id=7930b5f3583a4cb5abdc96cb2c60584f, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.195009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.228364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 999/2033] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:40 2022] PUT /identity/v3/projects/6727424e33804148a87e26602f702a0c/users/7930b5f3583a4cb5abdc96cb2c60584f/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:40.242128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.242619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.242912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.323336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] MFA Rules not processed for user `7930b5f3583a4cb5abdc96cb2c60584f`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:40.324849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:40.437082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1035/2034] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:40.441374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.540153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.541270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:40.551003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161bb1-779e-4c3a-9be5-2651d9009f94 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.556049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.556727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.557018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.557302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.558138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.560288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.568835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4af3a-0d93-401f-bec5-f097c59780cb None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.575893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.576933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.577149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.577502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] PATH_INFO: `/v3/projects/f579ee6b64bb4585b4ec336797b618a5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.579045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f579ee6b64bb4585b4ec336797b618a5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.581029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.607243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1000/2035] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:40 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:40.609335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.617309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:40.678897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f579ee6b64bb4585b4ec336797b618a5', 'request_id': 'req-a91775d5-17db-480f-be29-a20a2b031b58'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.689199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f579ee6b64bb4585b4ec336797b618a5', 'request_id': 'req-a91775d5-17db-480f-be29-a20a2b031b58'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.700727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f579ee6b64bb4585b4ec336797b618a5', 'request_id': 'req-a91775d5-17db-480f-be29-a20a2b031b58'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.719511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] The token cache is being invalidate because project f579ee6b64bb4585b4ec336797b618a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:40.720110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.720996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.723955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1036/2036] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:40 2022] DELETE /identity/v3/projects/f579ee6b64bb4585b4ec336797b618a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:40.732745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.734621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad14c-5ec7-4293-92de-7bb7246b71da admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.737162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:40.788464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:40.822757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.823385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.823629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.823936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.825479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.827332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.865675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91775d5-17db-480f-be29-a20a2b031b58 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.876252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.878025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.878477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.880186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1001/2037] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:40 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:40.881038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] PATH_INFO: `/v3/users/4fb9d00c33264a90bf6858407c0e90ef` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.882132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.883540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb9d00c33264a90bf6858407c0e90ef)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.885951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:40.887458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.911294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dd63c-f432-420f-8264-82cb972acd1c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.923260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.924220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.924508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.924786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.925536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.927200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.940013 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1002/2038] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:40.943163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:40.954600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881358a-acc6-4b4f-b473-238687fbca81 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:40.960085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af831633-8607-4073-954c-452301da1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:40.960983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af831633-8607-4073-954c-452301da1a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:40.961270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af831633-8607-4073-954c-452301da1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:40.961548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af831633-8607-4073-954c-452301da1a84 admin admin] PATH_INFO: `/v3/projects/cae9371831d54f7e8dda5f94790bccfc/users/1e9f06364f864a77b466f7ebc6cab77b/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:40.969778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb9d00c33264a90bf6858407c0e90ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.980149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af831633-8607-4073-954c-452301da1a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae9371831d54f7e8dda5f94790bccfc, user_id=1e9f06364f864a77b466f7ebc6cab77b, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:40.982905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb9d00c33264a90bf6858407c0e90ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.985765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af831633-8607-4073-954c-452301da1a84 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:40.992124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb9d00c33264a90bf6858407c0e90ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.992934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb9d00c33264a90bf6858407c0e90ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:40.993563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb9d00c33264a90bf6858407c0e90ef'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:41.011348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1003/2039] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:40 2022] PUT /identity/v3/projects/cae9371831d54f7e8dda5f94790bccfc/users/1e9f06364f864a77b466f7ebc6cab77b/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:41.015704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af831633-8607-4073-954c-452301da1a84 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:41.019534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-af831633-8607-4073-954c-452301da1a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:41.021163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1037/2040] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:40 2022] DELETE /identity/v3/users/4fb9d00c33264a90bf6858407c0e90ef => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:41.115242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af831633-8607-4073-954c-452301da1a84 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:41.128638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:41.229698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4b014-bbbd-458a-b130-c2732c6b76d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:41.230864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b014-bbbd-458a-b130-c2732c6b76d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:41.231297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b014-bbbd-458a-b130-c2732c6b76d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:41.231828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b014-bbbd-458a-b130-c2732c6b76d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:41.232719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4b014-bbbd-458a-b130-c2732c6b76d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:41.234519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4b014-bbbd-458a-b130-c2732c6b76d3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:41.253228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1004/2041] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:41.255977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:41.277809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89c4f7-c50d-426a-9753-b8374113a1a6 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:41.284148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:41.285223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:41.286308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:41.286776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] PATH_INFO: `/v3/projects/cae9371831d54f7e8dda5f94790bccfc/users/1e9f06364f864a77b466f7ebc6cab77b/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:41.289257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae9371831d54f7e8dda5f94790bccfc, user_id=1e9f06364f864a77b466f7ebc6cab77b, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:41.293147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:41.315987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1038/2042] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:41 2022] PUT /identity/v3/projects/cae9371831d54f7e8dda5f94790bccfc/users/1e9f06364f864a77b466f7ebc6cab77b/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:41.328003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:41.328319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:41.328584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:41.363321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] MFA Rules not processed for user `1e9f06364f864a77b466f7ebc6cab77b`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:41.364974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:41.511964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1005/2043] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:41.514789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:41.526311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:41.646064 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb0d7-e9f9-43e9-b843-2ee37feb57db admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:41.651199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:41.652221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:41.652912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:41.653543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:41.673048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:41.679672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:41.728119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1039/2044] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:41.941797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:41.969020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dd298-bd1e-4d28-a427-972054dd2ed5 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:41.977213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:41.980492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:41.980872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:41.981173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:41.987027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:42.195581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:42.200188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e36e5-7452-4397-a3ce-bcd3bbb29a7f service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:42.236870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1006/2045] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:42.647700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:42.649153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:42.723957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:42.808773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6748f5-7a53-445e-9413-038791e1c8cb service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:42.816944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:42.818454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:42.818964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:42.819828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] PATH_INFO: `/v3/projects/6a6e612ad9554a3cb2fa21d6dec30720` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:42.823120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6e612ad9554a3cb2fa21d6dec30720)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:42.825886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:42.893955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6e612ad9554a3cb2fa21d6dec30720', 'request_id': 'req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.901451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6e612ad9554a3cb2fa21d6dec30720', 'request_id': 'req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.909544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6e612ad9554a3cb2fa21d6dec30720', 'request_id': 'req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.924813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] The token cache is being invalidate because project 6a6e612ad9554a3cb2fa21d6dec30720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:42.925315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.926696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a2c4c8cc-b305-494a-8286-1bcaa92c8d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.929184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1040/2046] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:42 2022] DELETE /identity/v3/projects/6a6e612ad9554a3cb2fa21d6dec30720 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:42.934595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:42.935150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:42.935501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:42.955454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:42.956752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:42.986715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:43.025217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1007/2047] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:43.033352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.033650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.033936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.059234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:43.060701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.069380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1041/2048] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:43.073793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.084021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838de8bc-9899-4759-a298-5634c74a09c4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.089060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.089722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.090008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.090289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.091046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:43.091355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.092976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.105801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1008/2049] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:43.110246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.121500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0459-0ef9-422e-a5f5-f917948298b2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.126281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.126960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.127244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.127522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.128246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.130637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.161275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1042/2050] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:43.165047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.175278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957db5a7-9a9b-4670-a8c5-044df84489bf admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.264986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.266776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.271915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.276502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.276791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.277076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.277797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.279723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.293139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90594742-9d04-4a28-9922-ed28112f1d9e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.299623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.300933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.301685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.301985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] PATH_INFO: `/v3/users/94e35f09ec584525987f134c1e3d669a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.303428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e35f09ec584525987f134c1e3d669a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.305532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.316608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1009/2051] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:43.320933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.345207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8ade-7b6d-4ac8-97da-489ddfd273c9 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.354855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.356078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.356576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.357227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.358046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.359985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.371502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1010/2052] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:43.375193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.386252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c895fbe-c143-4afc-88e7-2feb9c84520a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.391446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.392303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.392714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.392994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.394030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.396791 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.402090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e35f09ec584525987f134c1e3d669a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.411934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1011/2053] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:43.416824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.423967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e35f09ec584525987f134c1e3d669a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.433712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e35f09ec584525987f134c1e3d669a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.434262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290e18c-6c50-412a-816c-30337ddccd19 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.434514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e35f09ec584525987f134c1e3d669a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.435194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2f449e77-41d9-49c5-9b8f-547e7386bafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e35f09ec584525987f134c1e3d669a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.444427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaff3c-fa55-4b0a-b824-4d78a0469bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.445439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff3c-fa55-4b0a-b824-4d78a0469bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.445795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff3c-fa55-4b0a-b824-4d78a0469bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.446529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaff3c-fa55-4b0a-b824-4d78a0469bcc admin admin] PATH_INFO: `/v3/projects/08596a277d554ded9cd20084bee3e7bb/users/c2612a8117394a5f989d6c187ba51450/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.460874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:43.469185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaff3c-fa55-4b0a-b824-4d78a0469bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=08596a277d554ded9cd20084bee3e7bb, user_id=c2612a8117394a5f989d6c187ba51450, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.472355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1043/2054] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:43 2022] DELETE /identity/v3/users/94e35f09ec584525987f134c1e3d669a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:43.472488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaff3c-fa55-4b0a-b824-4d78a0469bcc admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.474008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.474931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.475566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.508592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1012/2055] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:43 2022] PUT /identity/v3/projects/08596a277d554ded9cd20084bee3e7bb/users/c2612a8117394a5f989d6c187ba51450/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:43.509113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:43.509113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.512545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.512849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.513653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.549977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] MFA Rules not processed for user `c2612a8117394a5f989d6c187ba51450`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:43.550658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.591417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1044/2056] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:43.604764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.606762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.624186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:43.650767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1013/2057] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:43.663636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.665474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.693119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f4ab9-8197-4b61-a2c0-8f09c05b1949 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.699529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.700478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.700960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.701606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.712619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.714563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.725629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1045/2058] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:43.739774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20408-1894-4230-bfeb-88ff74cc20e9 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.744683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.745357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.745653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.745940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.756497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.758396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.781942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1014/2059] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:44.141490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:44.143810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:44.173243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ce8bf-9bca-4482-b894-a8983624637a service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:44.191161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:44.192655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.192956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.193242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] PATH_INFO: `/v3/projects/f5b31530e7c946b6be6352bdb2b56b47` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.194546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b31530e7c946b6be6352bdb2b56b47)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:44.196529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:44.282781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b31530e7c946b6be6352bdb2b56b47', 'request_id': 'req-5e9bd7fa-e750-40ad-8039-ae8309845eec'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.289362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b31530e7c946b6be6352bdb2b56b47', 'request_id': 'req-5e9bd7fa-e750-40ad-8039-ae8309845eec'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.296189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b31530e7c946b6be6352bdb2b56b47', 'request_id': 'req-5e9bd7fa-e750-40ad-8039-ae8309845eec'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.311846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] The token cache is being invalidate because project f5b31530e7c946b6be6352bdb2b56b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:44.312176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.312908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.314704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1046/2060] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:44 2022] DELETE /identity/v3/projects/f5b31530e7c946b6be6352bdb2b56b47 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:44.321748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:44.333248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892aa4b-f9a9-4354-8da0-56cd163927e9 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:44.403715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:44.404660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.405073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.405408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] PATH_INFO: `/v3/users/a587b6b1a4184532b309c6ffb417991e` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.406699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a587b6b1a4184532b309c6ffb417991e)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:44.408662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:44.460563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a587b6b1a4184532b309c6ffb417991e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.468895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a587b6b1a4184532b309c6ffb417991e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.476068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a587b6b1a4184532b309c6ffb417991e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.477025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a587b6b1a4184532b309c6ffb417991e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.477652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-201ae582-316b-48cc-869f-f6aa6b636568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a587b6b1a4184532b309c6ffb417991e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.495479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1015/2061] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:44 2022] DELETE /identity/v3/users/a587b6b1a4184532b309c6ffb417991e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:44.792493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:44.793988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:44.810398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd7fa-e750-40ad-8039-ae8309845eec admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:44.840412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:44.876249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:44.877114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.877399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.877681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] PATH_INFO: `/v3/projects/88b72d282e3143ea921ac35f0a622bf5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.878848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b72d282e3143ea921ac35f0a622bf5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:44.881590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:44.929736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b72d282e3143ea921ac35f0a622bf5', 'request_id': 'req-17d55580-c7b7-4574-93c0-382d94f2b4d7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.935378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b72d282e3143ea921ac35f0a622bf5', 'request_id': 'req-17d55580-c7b7-4574-93c0-382d94f2b4d7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.941547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b72d282e3143ea921ac35f0a622bf5', 'request_id': 'req-17d55580-c7b7-4574-93c0-382d94f2b4d7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.954577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] The token cache is being invalidate because project 88b72d282e3143ea921ac35f0a622bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:44.954867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.955488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-17d55580-c7b7-4574-93c0-382d94f2b4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.957072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1047/2062] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:44 2022] DELETE /identity/v3/projects/88b72d282e3143ea921ac35f0a622bf5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:44.962704 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.962998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.963333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.985346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:44.986551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:44.996726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:45.055153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1016/2063] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:45.065032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.065324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.065726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.086158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:45.087367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.095361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1048/2064] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:45.100343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.110136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fa73-8422-43a8-b9a5-861755a4c5bb None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.115184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.115836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.116145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.116422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.117146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:45.117454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.119053 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.130483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1017/2065] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:45.134827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.144034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e0ff1-4c5b-4728-a0f7-3824c050c2b6 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.148862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.149509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.149805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.150149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.150895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.152865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.178937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1049/2066] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:45.183129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.192794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46542eb-1e20-4c6d-85f2-235893f99190 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.258253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.258937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.259225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.259511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.260273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.262251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.283917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1018/2067] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:45.287685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.304398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683130d-22fe-4674-bed9-24d5e43a8bcc admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.308949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.309718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.310137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.310423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.311162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.312826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.326891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1050/2068] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:45.328344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.349216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c19d4-6e7a-477c-a1ba-b79e04cb657e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.355202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512161-d364-4c86-a411-c76cd17a36c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.355867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512161-d364-4c86-a411-c76cd17a36c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.356198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512161-d364-4c86-a411-c76cd17a36c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.356483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512161-d364-4c86-a411-c76cd17a36c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.357225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512161-d364-4c86-a411-c76cd17a36c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.358844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512161-d364-4c86-a411-c76cd17a36c6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.376215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1019/2069] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:45.378621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.390288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f3c5-8631-41b1-bb27-c55af695cb29 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.395676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.396613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.396900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.397179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] PATH_INFO: `/v3/projects/3311ad3bed5243629d22e1231e3878d5/users/bd52d9d31616462e8da535d99ec46243/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.416031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3311ad3bed5243629d22e1231e3878d5, user_id=bd52d9d31616462e8da535d99ec46243, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.418926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.433804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1051/2070] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:45 2022] PUT /identity/v3/projects/3311ad3bed5243629d22e1231e3878d5/users/bd52d9d31616462e8da535d99ec46243/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:45.444988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.445289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.445574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.474672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] MFA Rules not processed for user `bd52d9d31616462e8da535d99ec46243`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:45.475962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.559037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1020/2071] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:45.563731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.603005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.604588 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.617928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:45.624218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:45.637974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97cde-7b12-42c5-b443-e7a8aa1b195d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.644754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.645939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.646441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.646773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.647644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.650270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.687922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1052/2072] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:45.690200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.691062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9bea8-cf73-4dd2-a4e2-8829a750561c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.762020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.762961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.763252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.763529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] PATH_INFO: `/v3/users/3bf0ec6210de41f59e42a294adc8b9bc` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.764778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf0ec6210de41f59e42a294adc8b9bc)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.766059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a5777-29d5-407f-9c65-c363bcf1b46f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.766736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.772295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.773626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.773626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.773626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.774240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.776137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.798721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1053/2073] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:45.802767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.813852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e889f-196e-4b4d-81a7-8e7b4afa002c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.819659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.820364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.820655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.820937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.821861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.823663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.830596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf0ec6210de41f59e42a294adc8b9bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.835603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1054/2074] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:45.839640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.843131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf0ec6210de41f59e42a294adc8b9bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.850552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268a04f-8f9b-4091-b6db-cb8141a12271 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.853264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf0ec6210de41f59e42a294adc8b9bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.854170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf0ec6210de41f59e42a294adc8b9bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.855274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8885f2a8-6da8-4458-8efd-d11dbe5977e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf0ec6210de41f59e42a294adc8b9bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.857062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.858429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.858829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.859189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.860300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.862090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.875920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1055/2075] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:45.880932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.882870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.889436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1021/2076] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:45 2022] DELETE /identity/v3/users/3bf0ec6210de41f59e42a294adc8b9bc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:45.895972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.896723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.897199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.899282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4dce-c3fa-4c40-962c-44b981a61512 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.915042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:45.916279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.945980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:45.958501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317f817-32ec-4d7b-ad3e-0dd717ff08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.959430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f817-32ec-4d7b-ad3e-0dd717ff08e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.960135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f817-32ec-4d7b-ad3e-0dd717ff08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.960426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f817-32ec-4d7b-ad3e-0dd717ff08e7 admin admin] PATH_INFO: `/v3/projects/4cd3184fc6ce4a24a543f64bb64771c0/users/75935e770fe84077b89ef252ac82e549/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.975716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317f817-32ec-4d7b-ad3e-0dd717ff08e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd3184fc6ce4a24a543f64bb64771c0, user_id=75935e770fe84077b89ef252ac82e549, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.978352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1022/2077] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:45.981248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317f817-32ec-4d7b-ad3e-0dd717ff08e7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.990434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.992490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.996869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1056/2078] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:45 2022] PUT /identity/v3/projects/4cd3184fc6ce4a24a543f64bb64771c0/users/75935e770fe84077b89ef252ac82e549/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:46.009609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.009929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.010223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.038042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] MFA Rules not processed for user `75935e770fe84077b89ef252ac82e549`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:46.039288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.064201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f67b7-30d5-44f4-95e0-4f4a5b8ec1ab None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.065241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.123273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1057/2079] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:46.123448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.124182 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.124490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.124770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.127454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.191142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.193245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.198698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634d933-fecd-4af3-980c-999e289b0490 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.203197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1023/2080] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:46.203407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.204112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.204403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.204705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.205379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.207848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.238187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1058/2081] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:46.242426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.252645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28334a-f1a5-4ffb-a4a5-3696b30d4415 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.296230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.315496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.316227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.316545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.316906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.318139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.320097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.341151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1024/2082] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:46.346269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.359835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d6ff-2637-4eef-bfab-2169988c92b7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.369440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.372330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.372330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.372330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.372330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.373774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.385691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1059/2083] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:46.398268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.409760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0e64-5fce-4868-85ef-42f6e3ea0454 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.427633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.428796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.429181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.429830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] PATH_INFO: `/v3/projects/ae6c1c0a04804655b38b51eee0e85d5f/users/dbf978ba70e84af49319fde40d91cae3/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.448608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6c1c0a04804655b38b51eee0e85d5f, user_id=dbf978ba70e84af49319fde40d91cae3, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.451286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.466007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1025/2084] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:46 2022] PUT /identity/v3/projects/ae6c1c0a04804655b38b51eee0e85d5f/users/dbf978ba70e84af49319fde40d91cae3/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:46.470065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.481695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436da35-a9a0-4add-9510-f1131730ab8d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.515346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.517288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.550389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.551617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.551932 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.552242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.552946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.555253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.567988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1060/2085] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:46.570678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.584345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa7061-d006-4cb6-a3a5-af707fc899bc admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.589633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19c75-27bb-4b83-ad06-2014c41ea393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.590525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19c75-27bb-4b83-ad06-2014c41ea393 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.590808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19c75-27bb-4b83-ad06-2014c41ea393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.591086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19c75-27bb-4b83-ad06-2014c41ea393 admin admin] PATH_INFO: `/v3/projects/ae6c1c0a04804655b38b51eee0e85d5f/users/dbf978ba70e84af49319fde40d91cae3/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.593835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19c75-27bb-4b83-ad06-2014c41ea393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6c1c0a04804655b38b51eee0e85d5f, user_id=dbf978ba70e84af49319fde40d91cae3, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.596569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19c75-27bb-4b83-ad06-2014c41ea393 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.612043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1061/2086] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:46 2022] PUT /identity/v3/projects/ae6c1c0a04804655b38b51eee0e85d5f/users/dbf978ba70e84af49319fde40d91cae3/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:46.625326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.626065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.627398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.631763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacd672-88db-4f61-88bf-e25617bde62d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.671167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] MFA Rules not processed for user `dbf978ba70e84af49319fde40d91cae3`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:46.672468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.677569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.714786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.715999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.716353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.716701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] PATH_INFO: `/v3/projects/b8b58323fffe45eab9bc3da82ed25e6e` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.718408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b58323fffe45eab9bc3da82ed25e6e)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.720585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.788859 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1062/2087] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:46.803173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.808476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.808580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b58323fffe45eab9bc3da82ed25e6e', 'request_id': 'req-2b60a165-3774-4689-8940-24a1605b0698'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:46.813196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.814875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b58323fffe45eab9bc3da82ed25e6e', 'request_id': 'req-2b60a165-3774-4689-8940-24a1605b0698'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:46.827908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b58323fffe45eab9bc3da82ed25e6e', 'request_id': 'req-2b60a165-3774-4689-8940-24a1605b0698'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:46.845434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] The token cache is being invalidate because project b8b58323fffe45eab9bc3da82ed25e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:46.845910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:46.846515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:46.849409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1026/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:46 2022] DELETE /identity/v3/projects/b8b58323fffe45eab9bc3da82ed25e6e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:46.853761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.855692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.880246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d82d4f-6985-40c2-b18c-2cbba173d35b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.949839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.950742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.951030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.951313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.953718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.965513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a165-3774-4689-8940-24a1605b0698 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.976731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.978797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.979107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.980294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] PATH_INFO: `/v3/users/7930b5f3583a4cb5abdc96cb2c60584f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.981753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7930b5f3583a4cb5abdc96cb2c60584f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.983977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:47.046345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:47.048178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7930b5f3583a4cb5abdc96cb2c60584f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.048540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:47.067995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1063/2089] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:47.074255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7930b5f3583a4cb5abdc96cb2c60584f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.085383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7930b5f3583a4cb5abdc96cb2c60584f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.086339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7930b5f3583a4cb5abdc96cb2c60584f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.087131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7930b5f3583a4cb5abdc96cb2c60584f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.107484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1027/2090] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:46 2022] DELETE /identity/v3/users/7930b5f3583a4cb5abdc96cb2c60584f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:47.488274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:47.507350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e595d-ce56-45c6-8c68-35e9992e0b45 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:47.519798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:47.626955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:47.628137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:47.628630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:47.629111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] PATH_INFO: `/v3/projects/6727424e33804148a87e26602f702a0c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:47.630641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6727424e33804148a87e26602f702a0c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:47.633328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:47.693992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6727424e33804148a87e26602f702a0c', 'request_id': 'req-739576dc-127f-462a-bddd-84ebf430e871'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.699741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6727424e33804148a87e26602f702a0c', 'request_id': 'req-739576dc-127f-462a-bddd-84ebf430e871'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.706367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6727424e33804148a87e26602f702a0c', 'request_id': 'req-739576dc-127f-462a-bddd-84ebf430e871'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.720555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] The token cache is being invalidate because project 6727424e33804148a87e26602f702a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:47.720846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.721499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.723629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1064/2091] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:47 2022] DELETE /identity/v3/projects/6727424e33804148a87e26602f702a0c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:47.727952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:47.729566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:47.743764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5507b-a78f-4152-99d4-999af9654682 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:47.806104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:47.807021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:47.807314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:47.807608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] PATH_INFO: `/v3/users/1e9f06364f864a77b466f7ebc6cab77b` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:47.808924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9f06364f864a77b466f7ebc6cab77b)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:47.810955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:47.816007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:47.871001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9f06364f864a77b466f7ebc6cab77b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.878785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9f06364f864a77b466f7ebc6cab77b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.886590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9f06364f864a77b466f7ebc6cab77b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.887249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9f06364f864a77b466f7ebc6cab77b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.887973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9f06364f864a77b466f7ebc6cab77b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:47.907801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1028/2092] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:47 2022] DELETE /identity/v3/users/1e9f06364f864a77b466f7ebc6cab77b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:47.956762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:47.959097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:48.045332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739576dc-127f-462a-bddd-84ebf430e871 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.104219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.104794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.105352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.105632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.107424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:48.113829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:48.171052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.172612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9beeca5-47c8-43b0-ad4c-2d20c336e533 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.182007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1065/2093] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:48.198504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.200015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:48.288503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570ee9-171e-48da-a79c-12848c77f375 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.294210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.295447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.296041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.297343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] PATH_INFO: `/v3/projects/cae9371831d54f7e8dda5f94790bccfc` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.298722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae9371831d54f7e8dda5f94790bccfc)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.300743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.361525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae9371831d54f7e8dda5f94790bccfc', 'request_id': 'req-08f0a1be-206f-438c-aecb-bfafadd7c8c4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:48.368006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae9371831d54f7e8dda5f94790bccfc', 'request_id': 'req-08f0a1be-206f-438c-aecb-bfafadd7c8c4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:48.374939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae9371831d54f7e8dda5f94790bccfc', 'request_id': 'req-08f0a1be-206f-438c-aecb-bfafadd7c8c4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:48.391092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] The token cache is being invalidate because project cae9371831d54f7e8dda5f94790bccfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:48.392179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:48.392978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-08f0a1be-206f-438c-aecb-bfafadd7c8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:48.394979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1029/2094] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:48 2022] DELETE /identity/v3/projects/cae9371831d54f7e8dda5f94790bccfc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:48.400769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.401074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.401354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.421566 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:48.423087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:48.508962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1066/2095] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:48.518894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.519197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.519491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.555493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:48.560689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:48.571820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1030/2096] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:48.578368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.592033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa5243-e5a9-4f13-8ff1-96856e278d62 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.615638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.616360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.616653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.616939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.617776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:48.618097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.619718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.649624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1067/2097] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:48.654413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.673061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca471e-2157-4ee1-b1b1-4d19cabc3356 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.681014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.681014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.681014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.681014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.685049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.688171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.693559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:48.731925 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1031/2098] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:48 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:48.733613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.746346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ddd2e-8710-4d52-981d-7189953cf047 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.817981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.818684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.818972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.819362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.820073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.822012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.841935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1068/2099] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:48 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:48.846189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.858392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81158625-c0b8-49a4-a236-147cc4d14837 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.863057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.864794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.865085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.865370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.866113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.867709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.877730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1032/2100] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:48.882000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.891800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c721fa3-7048-4cf8-9e76-816cab3f1fc7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.896557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98989a-6389-43be-99e1-b4e439e42923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.897202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98989a-6389-43be-99e1-b4e439e42923 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.897484 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98989a-6389-43be-99e1-b4e439e42923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.897762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98989a-6389-43be-99e1-b4e439e42923 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.898482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98989a-6389-43be-99e1-b4e439e42923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.900345 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98989a-6389-43be-99e1-b4e439e42923 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.911241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1069/2101] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:48.915241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:48.925174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639858d-62e3-4f43-a3d5-d45f3b7b0424 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:48.931718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:48.931964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.932147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.932434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] PATH_INFO: `/v3/projects/cf879199160c4347a7358d5bf19fa705/users/340845de0d164ea4981fc17c466f03c1/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:48.950675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf879199160c4347a7358d5bf19fa705, user_id=340845de0d164ea4981fc17c466f03c1, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:48.953502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:48.967076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1033/2102] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:48 2022] PUT /identity/v3/projects/cf879199160c4347a7358d5bf19fa705/users/340845de0d164ea4981fc17c466f03c1/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:48.979099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:48.979674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:48.979674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.004882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:49.008340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] MFA Rules not processed for user `340845de0d164ea4981fc17c466f03c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:49.010208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:49.079591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1070/2103] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:49.084241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.148932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bdb9b-2f48-4084-880a-99725c33b087 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.153564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.154215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.154503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.154782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.155463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.157411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.183643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1034/2104] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:49 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:49.187714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.198983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958536a-1535-462a-b279-f03e329a1ef0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.259744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.260454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.260747 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.261038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.261730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.263710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.283769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1071/2105] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:49 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:49.287790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.298571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf150c-e2d8-4a1f-9f5e-590c38aad8ce admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.303731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.304710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.304886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.305171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.305905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.307651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.319323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1035/2106] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:49.323569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.333639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15e61-d877-4f2f-a712-2c482e4a9da9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.338515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.339256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.339536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.339811 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] PATH_INFO: `/v3/projects/55fa387ca053421dbaab9ac1d0da20d7/users/6369d1541155459e839104c1ea94de0b/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.340098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.342923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:49.356699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fa387ca053421dbaab9ac1d0da20d7, user_id=6369d1541155459e839104c1ea94de0b, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.359487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.373102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1072/2107] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:49 2022] PUT /identity/v3/projects/55fa387ca053421dbaab9ac1d0da20d7/users/6369d1541155459e839104c1ea94de0b/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:49.376902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.409657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c3733-7659-466c-8841-f518cf8f9ab8 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.439844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92da6-1dce-4b25-bfdd-54a262e645b4 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.444740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.445404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.445768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.446056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.446829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.448513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.449788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:49.460823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1073/2108] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:49.465138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.466369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.467300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.467453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.467678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.469579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:49.471807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:49.477719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070db6-6f65-4ada-871d-265e93ae9dad admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.483856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d2ea-a2e4-4d6c-a57f-2dbd773864ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.484926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d2ea-a2e4-4d6c-a57f-2dbd773864ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.485262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d2ea-a2e4-4d6c-a57f-2dbd773864ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.485542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d2ea-a2e4-4d6c-a57f-2dbd773864ab admin admin] PATH_INFO: `/v3/projects/55fa387ca053421dbaab9ac1d0da20d7/users/6369d1541155459e839104c1ea94de0b/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.488101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d2ea-a2e4-4d6c-a57f-2dbd773864ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fa387ca053421dbaab9ac1d0da20d7, user_id=6369d1541155459e839104c1ea94de0b, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.492353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d2ea-a2e4-4d6c-a57f-2dbd773864ab admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.511985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1074/2109] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:49 2022] PUT /identity/v3/projects/55fa387ca053421dbaab9ac1d0da20d7/users/6369d1541155459e839104c1ea94de0b/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:49.514525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e86b-9478-414d-8d42-102221227110 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.514826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e86b-9478-414d-8d42-102221227110 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.515180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e86b-9478-414d-8d42-102221227110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.543346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.545324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.555207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6d99e86b-9478-414d-8d42-102221227110 None None] MFA Rules not processed for user `6369d1541155459e839104c1ea94de0b`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:49.557019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6d99e86b-9478-414d-8d42-102221227110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:49.558615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1036/2110] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:49.646418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1075/2111] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:49.656374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.665568 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf639f-de69-4afc-8820-bf9f1a460ea8 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:49.729583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1176671-152f-4a08-8710-d4e4bb4ce338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:49.730533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176671-152f-4a08-8710-d4e4bb4ce338 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:49.730823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176671-152f-4a08-8710-d4e4bb4ce338 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:49.731107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1176671-152f-4a08-8710-d4e4bb4ce338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:49.740799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1176671-152f-4a08-8710-d4e4bb4ce338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:49.742225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1176671-152f-4a08-8710-d4e4bb4ce338 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:49.751862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1037/2112] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:49.939142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e86b-9478-414d-8d42-102221227110 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:49.942125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6d99e86b-9478-414d-8d42-102221227110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.018013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e86b-9478-414d-8d42-102221227110 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:50.023435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:50.024341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.024631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.025007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] PATH_INFO: `/v3/users/c2612a8117394a5f989d6c187ba51450` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.026270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2612a8117394a5f989d6c187ba51450)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:50.028464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:50.089814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2612a8117394a5f989d6c187ba51450'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.097341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2612a8117394a5f989d6c187ba51450'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.104763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2612a8117394a5f989d6c187ba51450'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.105682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2612a8117394a5f989d6c187ba51450'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.106328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2612a8117394a5f989d6c187ba51450'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.119170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:50.132679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1076/2113] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:49 2022] DELETE /identity/v3/users/c2612a8117394a5f989d6c187ba51450 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:50.136214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.136307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.136842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.184366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:50.186014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.264353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1038/2114] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:50.275085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:50.276802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.348828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63047dde-0109-49ae-9c9e-c3b16962559d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:50.352853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9741426-f0b3-4cc4-9c75-fe2a06162285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:50.353525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741426-f0b3-4cc4-9c75-fe2a06162285 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.353807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741426-f0b3-4cc4-9c75-fe2a06162285 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.354088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9741426-f0b3-4cc4-9c75-fe2a06162285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.368450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9741426-f0b3-4cc4-9c75-fe2a06162285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:50.370087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9741426-f0b3-4cc4-9c75-fe2a06162285 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:50.382908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1077/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:50.432414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:50.433930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.448607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f62c3-b8a8-4d78-9d3c-4efa2a246016 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:50.455175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:50.456119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.456408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.456690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] PATH_INFO: `/v3/users/340845de0d164ea4981fc17c466f03c1` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.459512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340845de0d164ea4981fc17c466f03c1)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:50.461526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:50.499859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:50.531782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340845de0d164ea4981fc17c466f03c1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.556067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340845de0d164ea4981fc17c466f03c1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.570171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340845de0d164ea4981fc17c466f03c1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.571114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340845de0d164ea4981fc17c466f03c1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.572002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340845de0d164ea4981fc17c466f03c1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.599295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1039/2116] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:50 2022] DELETE /identity/v3/users/340845de0d164ea4981fc17c466f03c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:50.604036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.604338 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.604629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.624683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:50.626041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.712413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1078/2117] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:50.724977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:50.726838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.734262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:50.735825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.750350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0582d-1893-47ef-a1bd-e2e2e14c50ad None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:50.778774 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:50.780061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.780383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.780854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] PATH_INFO: `/v3/projects/08596a277d554ded9cd20084bee3e7bb` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.789563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08596a277d554ded9cd20084bee3e7bb)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:50.799010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:50.839171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c8e3f-0eae-4df5-88a0-17cd5ee86650 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:50.843597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72ce5e-89f9-4d0a-a533-b9d75ceb8d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:50.844299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ce5e-89f9-4d0a-a533-b9d75ceb8d87 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.844783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ce5e-89f9-4d0a-a533-b9d75ceb8d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.845226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72ce5e-89f9-4d0a-a533-b9d75ceb8d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.857028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ce5e-89f9-4d0a-a533-b9d75ceb8d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:50.858711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72ce5e-89f9-4d0a-a533-b9d75ceb8d87 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:50.869634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08596a277d554ded9cd20084bee3e7bb', 'request_id': 'req-6571e39e-46b7-426f-9279-e5cdf840898b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.871528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1040/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:50.878295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08596a277d554ded9cd20084bee3e7bb', 'request_id': 'req-6571e39e-46b7-426f-9279-e5cdf840898b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.886068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08596a277d554ded9cd20084bee3e7bb', 'request_id': 'req-6571e39e-46b7-426f-9279-e5cdf840898b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.898471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] The token cache is being invalidate because project 08596a277d554ded9cd20084bee3e7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:50.898767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.899457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6571e39e-46b7-426f-9279-e5cdf840898b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:50.901300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1079/2119] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:50 2022] DELETE /identity/v3/projects/08596a277d554ded9cd20084bee3e7bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:50.906131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.906430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.906706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.927749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:50.929026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.012448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.012744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.013171 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.018300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1041/2120] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:51.037494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:51.038847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.055571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1080/2121] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:51.063188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.085696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939e46f-d4c4-4658-a2f8-4034bbe110df None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.101981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.102761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.103079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.103352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.104200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:51.104556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.107781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.126748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1042/2122] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:51.132641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.144358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254aa9b-e9ec-47c3-9b7d-037d062d0d5f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.150328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.151143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.151446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.151604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.152382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.154909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.170862 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:51.190865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1081/2123] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:51 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:51.196708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.215792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f74c81-9784-4e23-9fa7-29f51a265a51 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.273143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:51.322075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.322880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.323246 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.323535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.324794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.326770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.351914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1043/2124] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:51 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:51.355372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.366975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e689490-6f55-4b70-bb1e-dd85c530bd2a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.371861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.372638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.372937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.373210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.373946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.375546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.383201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.385014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.396003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1082/2125] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:51.398037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.401625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680496-0a8a-46fa-83f4-5cfcb9ce4bc1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.406857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.408160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.408516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.408863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] PATH_INFO: `/v3/projects/cf879199160c4347a7358d5bf19fa705` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.415690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c996707-3a00-4c42-8b84-ea9da81879c9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.416158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf879199160c4347a7358d5bf19fa705)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.418283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.420494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.421348 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.421934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.422232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.422963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.424604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.435354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1083/2126] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:51.439622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.449599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462faba-0fde-4d95-9465-9231394a7fe1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.455285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873588e-ddea-439d-a603-1d93730d08bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.456192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873588e-ddea-439d-a603-1d93730d08bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.456481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873588e-ddea-439d-a603-1d93730d08bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.456790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873588e-ddea-439d-a603-1d93730d08bc admin admin] PATH_INFO: `/v3/projects/4ef693ebdbe745e78d8d1c011439f961/users/946d7d3881744fe2af76f980f9944e30/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.473351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873588e-ddea-439d-a603-1d93730d08bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef693ebdbe745e78d8d1c011439f961, user_id=946d7d3881744fe2af76f980f9944e30, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.474376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf879199160c4347a7358d5bf19fa705', 'request_id': 'req-a21cc271-b43c-428f-8974-0fdbb9a8b24f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.475953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873588e-ddea-439d-a603-1d93730d08bc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.480483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf879199160c4347a7358d5bf19fa705', 'request_id': 'req-a21cc271-b43c-428f-8974-0fdbb9a8b24f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.487398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf879199160c4347a7358d5bf19fa705', 'request_id': 'req-a21cc271-b43c-428f-8974-0fdbb9a8b24f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.489636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1084/2127] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:51 2022] PUT /identity/v3/projects/4ef693ebdbe745e78d8d1c011439f961/users/946d7d3881744fe2af76f980f9944e30/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:51.501731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.502233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.502503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.508060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] The token cache is being invalidate because project cf879199160c4347a7358d5bf19fa705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:51.508639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.509300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.511104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1044/2128] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:51 2022] DELETE /identity/v3/projects/cf879199160c4347a7358d5bf19fa705 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:51.514661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.516033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.530855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] MFA Rules not processed for user `946d7d3881744fe2af76f980f9944e30`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:51.532101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.583489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cc271-b43c-428f-8974-0fdbb9a8b24f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.599521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1085/2129] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:51.603936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.605534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.635762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:51.646571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.647693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.648016 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.648304 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] PATH_INFO: `/v3/users/6369d1541155459e839104c1ea94de0b` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.649558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6369d1541155459e839104c1ea94de0b)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.651510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.674216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71072be8-5206-4e2c-a6d7-43573fe8c2db None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.679494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.680265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.680512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.680798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.681560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.683536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.703903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6369d1541155459e839104c1ea94de0b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.712307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1086/2130] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:51 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:51.716069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6369d1541155459e839104c1ea94de0b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.716571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.725931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6369d1541155459e839104c1ea94de0b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.726681 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6369d1541155459e839104c1ea94de0b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.727552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6369d1541155459e839104c1ea94de0b'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:51.747136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:51.751830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1045/2131] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:51 2022] DELETE /identity/v3/users/6369d1541155459e839104c1ea94de0b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:51.788433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f665-8231-46e9-aaf5-4377fb9b5c07 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.859530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.860536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.860765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.861058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.861867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.864028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.888381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1087/2132] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:51 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:51.892915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.894462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:51.908801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17bba-a2da-40b0-9169-df266fec9938 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.914895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.915655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.916050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.916397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.917320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.918945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.931973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1046/2133] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:51.934026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.945746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a72a3-8a64-4832-a2fe-f9e2efa6c3ef admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.950582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f11e7-a1dc-4892-9e5f-067b77b153dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.951265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f11e7-a1dc-4892-9e5f-067b77b153dd admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.951535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f11e7-a1dc-4892-9e5f-067b77b153dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.951819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f11e7-a1dc-4892-9e5f-067b77b153dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:51.953089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f11e7-a1dc-4892-9e5f-067b77b153dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:51.954259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f11e7-a1dc-4892-9e5f-067b77b153dd admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:51.965702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1088/2134] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:51.969706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:51.980703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82577a-642e-4c92-9740-4079450f8f60 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:51.985670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:51.986672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:51.987083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:51.987674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] PATH_INFO: `/v3/projects/357d7536ef9e4d4aae9f73f6a5e590a9/users/45a77b72f8c24ecd85b1dbb172b85c7c/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.003348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=357d7536ef9e4d4aae9f73f6a5e590a9, user_id=45a77b72f8c24ecd85b1dbb172b85c7c, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.006908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.021312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1047/2135] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:51 2022] PUT /identity/v3/projects/357d7536ef9e4d4aae9f73f6a5e590a9/users/45a77b72f8c24ecd85b1dbb172b85c7c/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:52.031514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.031812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.032136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.069358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] MFA Rules not processed for user `45a77b72f8c24ecd85b1dbb172b85c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:52.070670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.143542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1089/2136] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:52.148941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.160520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.162895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.227268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:52.228859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5a19-d516-4b08-a9e0-9db70941f8ef admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.235194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.235793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.236138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.236427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.237421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.239617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.254035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33741aff-2660-4900-a6d3-d22ee0300ac6 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.259482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.260382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.260676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.261007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] PATH_INFO: `/v3/projects/55fa387ca053421dbaab9ac1d0da20d7` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.262440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fa387ca053421dbaab9ac1d0da20d7)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.264527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.269419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1048/2137] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:52.270445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.297847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:52.317371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fa387ca053421dbaab9ac1d0da20d7', 'request_id': 'req-070388bb-59a3-4572-948e-349b7b05a873'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:52.325572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fa387ca053421dbaab9ac1d0da20d7', 'request_id': 'req-070388bb-59a3-4572-948e-349b7b05a873'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:52.332389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fa387ca053421dbaab9ac1d0da20d7', 'request_id': 'req-070388bb-59a3-4572-948e-349b7b05a873'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:52.350943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] The token cache is being invalidate because project 55fa387ca053421dbaab9ac1d0da20d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:52.351235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:52.351927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-070388bb-59a3-4572-948e-349b7b05a873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:52.352293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77846239-7fcc-4fc9-aeba-61ce8cf21e05 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.361828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1090/2138] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:52 2022] DELETE /identity/v3/projects/55fa387ca053421dbaab9ac1d0da20d7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:52.375997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b39658-9a40-43e7-9c0a-fb68fa8ced83 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.375997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b39658-9a40-43e7-9c0a-fb68fa8ced83 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.375997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b39658-9a40-43e7-9c0a-fb68fa8ced83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.408110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-50b39658-9a40-43e7-9c0a-fb68fa8ced83 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:52.410346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-50b39658-9a40-43e7-9c0a-fb68fa8ced83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.424722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.425406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.426264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.426542 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.427480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.430282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.465759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1049/2139] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:52.470500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.472466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.486675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae802272-eb39-4154-a2a0-baa4fe4e4c8e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.492567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.493251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.493547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.493878 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.494622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.496586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.498451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1091/2140] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:52.508156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.508467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.508867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.516126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1050/2141] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:52.521449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.531794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:52.533118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.533747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d601c1-24c8-4b00-9e59-85f90c053130 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.539738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.540670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.541135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.541423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] PATH_INFO: `/v3/projects/636822b1edad4d5c98e4a6f423970cae/users/72f119ccedb44d59a4769ba213166fae/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.542656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1092/2142] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:52.547002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.559210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636822b1edad4d5c98e4a6f423970cae, user_id=72f119ccedb44d59a4769ba213166fae, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.559427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddba296-ecd9-467e-b825-6430401c3bf0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.563930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.571290 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.572118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.572477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.572907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.573662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:52.574087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.575806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.577161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1051/2143] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:52 2022] PUT /identity/v3/projects/636822b1edad4d5c98e4a6f423970cae/users/72f119ccedb44d59a4769ba213166fae/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:52.580754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.583421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.595056 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1093/2144] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:28:52.596405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.608170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72a3eb-eac8-4028-bcf0-d0663de81b30 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.651414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c86551-1a02-4357-972e-21ef682e1094 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.654311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:52.655276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.656015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.656316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.656600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.658650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.669010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.669676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.669981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.670240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.670994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.672661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.682690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1094/2145] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:52.683476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.693304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfeb09-9041-4cb5-a7e1-83afdd99500d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.697865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.698513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.698777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.699074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.699723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.701640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.706545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:52.729708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1095/2146] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:52.733905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.734232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.735698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.745660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1052/2147] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:52.748726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.759673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd3359-e85c-4684-9391-55198585a930 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.811027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437104bf-948f-4f55-bc7a-5a76f48f6441 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.818845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f93cf-44a4-4a25-9f57-2d876e4c5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.819766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f93cf-44a4-4a25-9f57-2d876e4c5f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.820654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f93cf-44a4-4a25-9f57-2d876e4c5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.820957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f93cf-44a4-4a25-9f57-2d876e4c5f46 admin admin] PATH_INFO: `/v3/projects/636822b1edad4d5c98e4a6f423970cae/users/72f119ccedb44d59a4769ba213166fae/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.823038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f93cf-44a4-4a25-9f57-2d876e4c5f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636822b1edad4d5c98e4a6f423970cae, user_id=72f119ccedb44d59a4769ba213166fae, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.824997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.825682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.825978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.826275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.826658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f93cf-44a4-4a25-9f57-2d876e4c5f46 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.827033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.829107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.841696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1096/2148] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:52 2022] PUT /identity/v3/projects/636822b1edad4d5c98e4a6f423970cae/users/72f119ccedb44d59a4769ba213166fae/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:52.852873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.853166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.853450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.858481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1053/2149] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:52.862339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.876873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff78201-8a3e-4198-919f-c2bfb6d81496 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.886830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] MFA Rules not processed for user `72f119ccedb44d59a4769ba213166fae`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:52.888270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:52.943773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.944850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.944850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.945609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.946233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.947936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:52.959234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1054/2150] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:52.962990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:52.975195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679142e-f188-475e-8eda-e696b753d304 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:52.981915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1097/2151] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:52.990343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:52.991032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:52.991352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:52.991605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:52.992549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:52.994373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:53.011730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1055/2152] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:53.016046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:53.028956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a77c9-44aa-4bda-b598-110a62b07483 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:53.033918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07a97b-cd36-4734-b631-7ad4a0acfe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:53.034819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a97b-cd36-4734-b631-7ad4a0acfe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:53.035131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a97b-cd36-4734-b631-7ad4a0acfe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:53.035609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07a97b-cd36-4734-b631-7ad4a0acfe81 admin admin] PATH_INFO: `/v3/projects/5538e049ad5f4831878f5238de4f2bd4/users/ab040a1e270047a69ad231b54f43bb76/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:53.039717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:53.041575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:53.053442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07a97b-cd36-4734-b631-7ad4a0acfe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5538e049ad5f4831878f5238de4f2bd4, user_id=ab040a1e270047a69ad231b54f43bb76, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:53.056149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07a97b-cd36-4734-b631-7ad4a0acfe81 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:53.071920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1098/2153] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:53 2022] PUT /identity/v3/projects/5538e049ad5f4831878f5238de4f2bd4/users/ab040a1e270047a69ad231b54f43bb76/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:53.083269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:53.084653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:53.084950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:53.112146 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e819b95-3f5c-4d8e-8a0e-4683d87654d4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:53.115149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] MFA Rules not processed for user `ab040a1e270047a69ad231b54f43bb76`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:53.116390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:53.122066 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:53.125175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:53.200692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:53.204058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:53.204357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:53.204675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:53.215572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:53.241353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1099/2154] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:53.329796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:53.331321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:53.346293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1056/2155] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:53.355159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:53.372254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ab2e-059b-419f-9f4c-1790e3e76ec0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:53.392471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20886003-e065-46ab-b1b4-9c9a67ba6df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:53.393154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20886003-e065-46ab-b1b4-9c9a67ba6df9 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:53.393449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20886003-e065-46ab-b1b4-9c9a67ba6df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:53.393927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20886003-e065-46ab-b1b4-9c9a67ba6df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:53.411278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20886003-e065-46ab-b1b4-9c9a67ba6df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:53.414321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20886003-e065-46ab-b1b4-9c9a67ba6df9 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:53.432670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1100/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:55.421940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:55.423376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.505792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c90e-57ff-432b-8d9c-b612008c3b22 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:55.510849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:55.511727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.512046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.512329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] PATH_INFO: `/v3/users/bd52d9d31616462e8da535d99ec46243` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.513544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd52d9d31616462e8da535d99ec46243)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:55.515498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:55.571410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd52d9d31616462e8da535d99ec46243'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.579658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd52d9d31616462e8da535d99ec46243'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.588348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd52d9d31616462e8da535d99ec46243'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.588943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd52d9d31616462e8da535d99ec46243'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.589618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd52d9d31616462e8da535d99ec46243'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.594551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:55.616318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1057/2157] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:55 2022] DELETE /identity/v3/users/bd52d9d31616462e8da535d99ec46243 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:55.620706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.621212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.621312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.639543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:55.640806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.700760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1101/2158] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:55.711306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:55.712816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.778263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d70be-2ca2-4a4d-baac-9ed40a9af8db admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:55.783622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:55.784538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.784671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.784872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.795294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:55.796796 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:55.807028 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1058/2159] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:56.112455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.115691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.130122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f941cd6-f24b-4fa9-b5ef-342628f40eb1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.136654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.137705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.137987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.138341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] PATH_INFO: `/v3/projects/3311ad3bed5243629d22e1231e3878d5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.140234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3311ad3bed5243629d22e1231e3878d5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.152087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.232657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3311ad3bed5243629d22e1231e3878d5', 'request_id': 'req-54316dc5-a262-4395-840b-1c55e83fe4d5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.235640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3311ad3bed5243629d22e1231e3878d5', 'request_id': 'req-54316dc5-a262-4395-840b-1c55e83fe4d5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.245182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3311ad3bed5243629d22e1231e3878d5', 'request_id': 'req-54316dc5-a262-4395-840b-1c55e83fe4d5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.262011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.265631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.266059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] The token cache is being invalidate because project 3311ad3bed5243629d22e1231e3878d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:56.266353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.267533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.270149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1102/2160] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:56 2022] DELETE /identity/v3/projects/3311ad3bed5243629d22e1231e3878d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:56.274464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.276106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.298773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:56.341402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8b70-fd00-4af1-9d3f-534832010b64 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.370947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316dc5-a262-4395-840b-1c55e83fe4d5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.376197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.377076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.377362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.377643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] PATH_INFO: `/v3/users/75935e770fe84077b89ef252ac82e549` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.379071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75935e770fe84077b89ef252ac82e549)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.381044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.406556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.407451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.407678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.408057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.410563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.439498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75935e770fe84077b89ef252ac82e549'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.448306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75935e770fe84077b89ef252ac82e549'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.455577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75935e770fe84077b89ef252ac82e549'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.456334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75935e770fe84077b89ef252ac82e549'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.457702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75935e770fe84077b89ef252ac82e549'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.478054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1103/2161] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:56 2022] DELETE /identity/v3/users/75935e770fe84077b89ef252ac82e549 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:56.478297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.480219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.486087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:56.498230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1059/2162] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:56.800555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.803328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.874732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e2fca-2bc3-432f-8858-8cddd2f58f91 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.880292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.881187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.881479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.881760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] PATH_INFO: `/v3/projects/4cd3184fc6ce4a24a543f64bb64771c0` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.882952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd3184fc6ce4a24a543f64bb64771c0)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.884908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.925375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:56.937877 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd3184fc6ce4a24a543f64bb64771c0', 'request_id': 'req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.944430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd3184fc6ce4a24a543f64bb64771c0', 'request_id': 'req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.952495 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd3184fc6ce4a24a543f64bb64771c0', 'request_id': 'req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.966726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] The token cache is being invalidate because project 4cd3184fc6ce4a24a543f64bb64771c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:56.967018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.967651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:56.969505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1104/2163] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:56 2022] DELETE /identity/v3/projects/4cd3184fc6ce4a24a543f64bb64771c0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:56.974263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.986615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b1728-0f8f-41bf-80ec-7821bbc8b7de service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:57.050506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:57.051442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.051740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.052189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] PATH_INFO: `/v3/users/dbf978ba70e84af49319fde40d91cae3` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.053776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf978ba70e84af49319fde40d91cae3)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:57.055902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:57.124094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf978ba70e84af49319fde40d91cae3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.132990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf978ba70e84af49319fde40d91cae3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.143443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf978ba70e84af49319fde40d91cae3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.144485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf978ba70e84af49319fde40d91cae3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.145657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf978ba70e84af49319fde40d91cae3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.165959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1060/2164] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:56 2022] DELETE /identity/v3/users/dbf978ba70e84af49319fde40d91cae3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:57.245226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:57.247931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:57.350595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdbf31-72bd-4722-9228-8c0d684f4b4a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:57.407682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:57.408364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.408654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.408933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.411421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:57.492622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:57.492786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:57.494091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49270ebd-2046-46d7-85a4-70460801ff61 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:57.494621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:57.514286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1105/2165] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:57.591003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56615-0876-4086-8cf7-5785d9c094c6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:57.596331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:57.597201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.597785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.598074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] PATH_INFO: `/v3/projects/ae6c1c0a04804655b38b51eee0e85d5f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.599362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6c1c0a04804655b38b51eee0e85d5f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:57.601468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:57.628280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:57.664366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6c1c0a04804655b38b51eee0e85d5f', 'request_id': 'req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.670501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6c1c0a04804655b38b51eee0e85d5f', 'request_id': 'req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.677923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6c1c0a04804655b38b51eee0e85d5f', 'request_id': 'req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.692246 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] The token cache is being invalidate because project ae6c1c0a04804655b38b51eee0e85d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:57.692489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.693468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e2dcb57e-e3ad-4e01-98dd-bbb69248c927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:57.695252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1061/2166] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:57 2022] DELETE /identity/v3/projects/ae6c1c0a04804655b38b51eee0e85d5f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:57.702586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.702975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.703261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.721356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:57.723133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:57.756848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:57.799221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1106/2167] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:57.801109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.801488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.801716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.826147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:57.827363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:57.835783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1062/2168] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:57.839540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:57.852782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121865df-55ab-4d4a-a8f8-36e1fb1a71f5 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:57.861637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:57.862579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.863778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.864435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.865313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:57.865645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:57.868276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:57.882978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1107/2169] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:57.887390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:57.898424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43022e-09c4-4da0-b1f6-0521bc99c36f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:57.903731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:57.904569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:57.904986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:57.905317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:57.906110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:57.908413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:57.951597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1063/2170] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:57 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:57.955777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:57.968235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21eb0d-fa4e-4ce0-933d-a17f726f9e29 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:58.036311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:58.037274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:58.037620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:58.038049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:58.038768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:58.040823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:58.072428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1108/2171] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:57 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:58.076805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:58.088136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec052df-9ef7-45fd-a964-04fde48feb9d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:58.092885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:58.094114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:58.094114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:58.094334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:58.094925 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:58.096591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:58.108614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1064/2172] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:58.112551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:58.124642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8546a-6fe6-4d67-be8f-497a6211895d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:58.129623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda9d71-e764-4245-a80f-6962ba88e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:58.130373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda9d71-e764-4245-a80f-6962ba88e47e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:58.130731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda9d71-e764-4245-a80f-6962ba88e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:58.131076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda9d71-e764-4245-a80f-6962ba88e47e admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:58.131824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda9d71-e764-4245-a80f-6962ba88e47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:58.133471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda9d71-e764-4245-a80f-6962ba88e47e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:58.147409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1109/2173] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:58.151709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:58.163809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9bbf5-9df2-48ce-855e-8dc4f6f7cbd4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:58.174119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:58.174119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:58.174119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:58.174119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] PATH_INFO: `/v3/projects/06e75b054fd14b77b20591f8c078fdf8/users/af38f9b39b3c4f71b619b8b599d6d6a4/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:58.194445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e75b054fd14b77b20591f8c078fdf8, user_id=af38f9b39b3c4f71b619b8b599d6d6a4, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:58.197593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:58.212943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1065/2174] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:58 2022] PUT /identity/v3/projects/06e75b054fd14b77b20591f8c078fdf8/users/af38f9b39b3c4f71b619b8b599d6d6a4/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:58.226463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066409e6-d996-4693-82f6-30218967e0cc None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:58.226760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066409e6-d996-4693-82f6-30218967e0cc None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:58.227046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066409e6-d996-4693-82f6-30218967e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:58.254557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-066409e6-d996-4693-82f6-30218967e0cc None None] MFA Rules not processed for user `af38f9b39b3c4f71b619b8b599d6d6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:58.255744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-066409e6-d996-4693-82f6-30218967e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:58.329735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1110/2175] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:58.342389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:58.344142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:58.406436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec18b9-62cd-4282-9b82-4caf29e06cf5 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:58.411738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563117-bb47-4088-ad58-7e37f4ee45a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:58.412443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563117-bb47-4088-ad58-7e37f4ee45a7 service glance] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:58.412736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563117-bb47-4088-ad58-7e37f4ee45a7 service glance] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:58.413054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563117-bb47-4088-ad58-7e37f4ee45a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:58.423458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563117-bb47-4088-ad58-7e37f4ee45a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:58.427516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563117-bb47-4088-ad58-7e37f4ee45a7 service glance] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:58.438464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1066/2176] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:59.062624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066409e6-d996-4693-82f6-30218967e0cc None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:59.062624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-066409e6-d996-4693-82f6-30218967e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:59.127733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:59.181405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066409e6-d996-4693-82f6-30218967e0cc None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:59.188259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:59.189174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:59.189814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:59.190133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] PATH_INFO: `/v3/users/ab040a1e270047a69ad231b54f43bb76` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:59.193845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab040a1e270047a69ad231b54f43bb76)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:59.197981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:59.258814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab040a1e270047a69ad231b54f43bb76'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:59.268718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab040a1e270047a69ad231b54f43bb76'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:59.277473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab040a1e270047a69ad231b54f43bb76'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:59.278456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab040a1e270047a69ad231b54f43bb76'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:59.279569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab040a1e270047a69ad231b54f43bb76'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:59.307754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1111/2177] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:59 2022] DELETE /identity/v3/users/ab040a1e270047a69ad231b54f43bb76 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:59.312571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:59.313148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:59.313148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:59.337273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:59.338532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:59.426366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:59.452268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1067/2178] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:59.463082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:59.464784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:59.546265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721dae6-b16f-4763-a1d1-87106c18b826 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:59.556788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:59.558062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:59.558563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:59.559050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:59.574423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:59.576499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:59.592430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1112/2179] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:59.920928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:59.922714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:59.962261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa29753-5d9e-4b92-8636-e0a21de8f90f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:59.968779 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:59.970213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:59.970646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:59.971106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] PATH_INFO: `/v3/projects/5538e049ad5f4831878f5238de4f2bd4` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:59.973595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5538e049ad5f4831878f5238de4f2bd4)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:59.976503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:00.068204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5538e049ad5f4831878f5238de4f2bd4', 'request_id': 'req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:00.074294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5538e049ad5f4831878f5238de4f2bd4', 'request_id': 'req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:00.081910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5538e049ad5f4831878f5238de4f2bd4', 'request_id': 'req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:00.103391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] The token cache is being invalidate because project 5538e049ad5f4831878f5238de4f2bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:00.103807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:00.104498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:00.106724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1068/2180] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:59 2022] DELETE /identity/v3/projects/5538e049ad5f4831878f5238de4f2bd4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:01.565565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:01.570895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:01.591705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbaca7-7ffb-4444-bf73-a4c1c734f269 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:01.650135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:01.662756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:01.663558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:01.664099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:01.664528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] PATH_INFO: `/v3/users/cda9c69ed6594c0a8a95a945dff57fba` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:01.665959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda9c69ed6594c0a8a95a945dff57fba)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:01.667983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:01.723295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda9c69ed6594c0a8a95a945dff57fba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.734475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda9c69ed6594c0a8a95a945dff57fba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.742709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda9c69ed6594c0a8a95a945dff57fba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.743358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda9c69ed6594c0a8a95a945dff57fba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.744022 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda9c69ed6594c0a8a95a945dff57fba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.762439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1113/2181] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:01 2022] DELETE /identity/v3/users/cda9c69ed6594c0a8a95a945dff57fba => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:01.775712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:01.777338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:01.791036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff8975-a3b5-4fd1-bad1-6d61c3d4f552 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:01.872529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:01.873677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:01.873967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:01.874254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] PATH_INFO: `/v3/users/946d7d3881744fe2af76f980f9944e30` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:01.875490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946d7d3881744fe2af76f980f9944e30)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:01.877576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:01.938809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946d7d3881744fe2af76f980f9944e30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.950186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946d7d3881744fe2af76f980f9944e30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.959617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946d7d3881744fe2af76f980f9944e30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.960447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946d7d3881744fe2af76f980f9944e30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.961125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-75a8753a-dce2-4022-a4c4-93c95c74f870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946d7d3881744fe2af76f980f9944e30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:01.969068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:01.970505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:01.976936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:01.992530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1069/2182] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:01 2022] DELETE /identity/v3/users/946d7d3881744fe2af76f980f9944e30 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:01.997379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:01.997988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:01.998346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.000777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1b020-faeb-4c7f-bbfd-341cc3e8bf95 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.018772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:02.020913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.095061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.096646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.097451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.097785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] PATH_INFO: `/v3/projects/f9292660d01b4f72b71e7487cddc0ba8` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.100363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9292660d01b4f72b71e7487cddc0ba8)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.103084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1070/2183] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:02.103752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.114638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.116926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.187594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9292660d01b4f72b71e7487cddc0ba8', 'request_id': 'req-0be33dfb-7818-463a-b52f-bef3080891f4'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.194437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9292660d01b4f72b71e7487cddc0ba8', 'request_id': 'req-0be33dfb-7818-463a-b52f-bef3080891f4'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.195904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee65b10-35fb-4a14-9481-c99084b9d7b1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.201297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9292660d01b4f72b71e7487cddc0ba8', 'request_id': 'req-0be33dfb-7818-463a-b52f-bef3080891f4'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.212110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:02.217029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] The token cache is being invalidate because project f9292660d01b4f72b71e7487cddc0ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:02.217786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.219130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0be33dfb-7818-463a-b52f-bef3080891f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.221375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1114/2184] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:01 2022] DELETE /identity/v3/projects/f9292660d01b4f72b71e7487cddc0ba8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:02.227631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4fd9d-bd1e-4e4f-b5be-d85bb6cc71ba None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.228144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4fd9d-bd1e-4e4f-b5be-d85bb6cc71ba None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.228436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4fd9d-bd1e-4e4f-b5be-d85bb6cc71ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.247305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-68f4fd9d-bd1e-4e4f-b5be-d85bb6cc71ba None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:02.248533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-68f4fd9d-bd1e-4e4f-b5be-d85bb6cc71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.254728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.255400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.255729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.256058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.258592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.322764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1115/2185] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:02.330801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.331104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.331382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.337514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:02.340382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.343245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.353005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:02.354166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.357555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1071/2186] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:02.363819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1116/2187] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:02.368340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.383782 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4afa48-f7de-47ea-a9ad-26105a39c7ca service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.388633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.389301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.389585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.389945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.390688 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:02.390994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.393135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.408385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1072/2188] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:02.413886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.425042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709c895-0331-45f3-adc6-173c0a81c052 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.430140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.430823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.431121 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.431407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.432163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.434382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.469115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1117/2189] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:02 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:29:02.473822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.485657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbebec-d082-49f0-8fb5-fe8045076e4e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.562151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.562841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.563132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.563416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.564222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.566794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.595799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1073/2190] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:02 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:02.597232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.610488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cce4d-ac28-48ef-9b8a-7aa07c16c648 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.620277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.621242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.621744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.622246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.623467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.625535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.639297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1118/2191] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:02.644885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.667759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358b2a-d625-46c1-ae18-7e8070918df5 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.677108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.677899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.678348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.678946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.680062 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.685357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.715608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.718658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.723991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1074/2192] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:29:02.724928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.738127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1a34-782c-4963-8fda-d419834501d6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.755122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf30d5d-c52c-4a07-bb5e-a317d801f64c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.759945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e2ef0-0a66-4a4a-a09a-646112838ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.760858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2ef0-0a66-4a4a-a09a-646112838ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.761157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2ef0-0a66-4a4a-a09a-646112838ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.761555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e2ef0-0a66-4a4a-a09a-646112838ea7 admin admin] PATH_INFO: `/v3/projects/fb169552f35d46068965a07c802f9d1c/users/8e388fb4942847e1b671e6e6da0a72b6/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.762732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.763805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.764182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.764538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] PATH_INFO: `/v3/projects/4ef693ebdbe745e78d8d1c011439f961` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.766465 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef693ebdbe745e78d8d1c011439f961)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.768854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.786854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2ef0-0a66-4a4a-a09a-646112838ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb169552f35d46068965a07c802f9d1c, user_id=8e388fb4942847e1b671e6e6da0a72b6, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.793843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e2ef0-0a66-4a4a-a09a-646112838ea7 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.822193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1075/2193] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:02 2022] PUT /identity/v3/projects/fb169552f35d46068965a07c802f9d1c/users/8e388fb4942847e1b671e6e6da0a72b6/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:02.827179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436e41-917e-4ef5-a009-93b617588593 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.827518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436e41-917e-4ef5-a009-93b617588593 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.827802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436e41-917e-4ef5-a009-93b617588593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.830367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef693ebdbe745e78d8d1c011439f961', 'request_id': 'req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.838206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef693ebdbe745e78d8d1c011439f961', 'request_id': 'req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.853633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef693ebdbe745e78d8d1c011439f961', 'request_id': 'req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.853741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-07436e41-917e-4ef5-a009-93b617588593 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:02.853741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-07436e41-917e-4ef5-a009-93b617588593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.867703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] The token cache is being invalidate because project 4ef693ebdbe745e78d8d1c011439f961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:02.868033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.870047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:02.871981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1119/2194] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:02 2022] DELETE /identity/v3/projects/4ef693ebdbe745e78d8d1c011439f961 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:02.875542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.877161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.927557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1076/2195] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:02.936300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:02.937199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436e41-917e-4ef5-a009-93b617588593 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:02.938951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-07436e41-917e-4ef5-a009-93b617588593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:02.961562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2bcdf-fe4b-4a46-8eea-bce0aede28f6 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:02.968043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:02.968990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:02.969287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:02.969572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] PATH_INFO: `/v3/users/45a77b72f8c24ecd85b1dbb172b85c7c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:02.971222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a77b72f8c24ecd85b1dbb172b85c7c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:02.973678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:02.986573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:03.005660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436e41-917e-4ef5-a009-93b617588593 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:03.009510 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:03.010265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:03.010569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:03.010933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:03.020813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:03.022346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:03.028909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a77b72f8c24ecd85b1dbb172b85c7c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.032616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1077/2196] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:03.037128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a77b72f8c24ecd85b1dbb172b85c7c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.044763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a77b72f8c24ecd85b1dbb172b85c7c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.045552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a77b72f8c24ecd85b1dbb172b85c7c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.046276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a77b72f8c24ecd85b1dbb172b85c7c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.074624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1120/2197] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:02 2022] DELETE /identity/v3/users/45a77b72f8c24ecd85b1dbb172b85c7c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:03.425120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:03.439219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843ace-9ab4-4dd7-ba58-55002e54431a service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:03.521746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:03.526355 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:03.526677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:03.527194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] PATH_INFO: `/v3/projects/357d7536ef9e4d4aae9f73f6a5e590a9` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:03.528733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357d7536ef9e4d4aae9f73f6a5e590a9)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:03.531369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:03.590475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357d7536ef9e4d4aae9f73f6a5e590a9', 'request_id': 'req-506e0410-e1ba-4962-af7e-1fe72b217b29'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.596322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357d7536ef9e4d4aae9f73f6a5e590a9', 'request_id': 'req-506e0410-e1ba-4962-af7e-1fe72b217b29'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.603296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357d7536ef9e4d4aae9f73f6a5e590a9', 'request_id': 'req-506e0410-e1ba-4962-af7e-1fe72b217b29'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.617377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] The token cache is being invalidate because project 357d7536ef9e4d4aae9f73f6a5e590a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:03.617670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.618295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.619842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1078/2198] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:03 2022] DELETE /identity/v3/projects/357d7536ef9e4d4aae9f73f6a5e590a9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:03.624038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:03.625460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:03.640391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2202a6f-2a5e-4bf3-80ca-ecd241e3a8ba admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:03.715925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:03.715925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:03.715925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:03.715925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] PATH_INFO: `/v3/users/72f119ccedb44d59a4769ba213166fae` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:03.716761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f119ccedb44d59a4769ba213166fae)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:03.716761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:03.777695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f119ccedb44d59a4769ba213166fae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.791252 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f119ccedb44d59a4769ba213166fae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.804206 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f119ccedb44d59a4769ba213166fae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.805311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f119ccedb44d59a4769ba213166fae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.805969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-80df761a-f692-4345-bfae-8a7807b196df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f119ccedb44d59a4769ba213166fae'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:03.808357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:03.836387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1121/2199] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:03 2022] DELETE /identity/v3/users/72f119ccedb44d59a4769ba213166fae => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:04.215518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:04.217102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:04.241202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0410-e1ba-4962-af7e-1fe72b217b29 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:04.369951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:04.372090 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.372462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.372859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] PATH_INFO: `/v3/projects/636822b1edad4d5c98e4a6f423970cae` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.374265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636822b1edad4d5c98e4a6f423970cae)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:04.376732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:04.395901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:04.459889 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636822b1edad4d5c98e4a6f423970cae', 'request_id': 'req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:04.480340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636822b1edad4d5c98e4a6f423970cae', 'request_id': 'req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:04.519091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636822b1edad4d5c98e4a6f423970cae', 'request_id': 'req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:04.546881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] The token cache is being invalidate because project 636822b1edad4d5c98e4a6f423970cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:04.547192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:04.549001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba9f9ee0-7c36-40ae-9ca2-096a305edd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:04.549908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1079/2200] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:04 2022] DELETE /identity/v3/projects/636822b1edad4d5c98e4a6f423970cae => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:04.555505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.555815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.556132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.577049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:04.578265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:04.654788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1122/2201] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:04.656484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.656787 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.657076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.678270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:04.679551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:04.687982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1080/2202] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:04.692279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:04.705212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71bc8a-642a-4972-a486-6df8bb22ab5a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:04.717357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:04.718189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.718487 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.718767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.719547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:04.719861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:04.721515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:04.735675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1123/2203] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:04.740769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:04.757498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced66b26-fb9e-4e56-8e06-787e259ec580 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:04.763372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:04.764095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.764381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.764665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.765377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:04.767369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:04.821352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1081/2204] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:04 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:04.826556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:04.837803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11751912-6425-47b2-9f55-797a619eb341 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:04.907976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:04.909037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.909540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.914302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.914302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:04.914914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:04.952761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1124/2205] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:04 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:29:04.958045 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:04.987147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de7a1-e288-42d6-a1e0-ba9164f6d321 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:04.993243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:04.993946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:04.994231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:04.994515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:04.995252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:04.996934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:05.009175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1082/2206] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:05.013283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:05.024953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60038d92-b795-405c-ac7b-f2931bdcec7c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:05.031945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af9061-ebbd-48c1-aa1e-77239f3fbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:05.032739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af9061-ebbd-48c1-aa1e-77239f3fbc5c admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:05.033099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af9061-ebbd-48c1-aa1e-77239f3fbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:05.033455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af9061-ebbd-48c1-aa1e-77239f3fbc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:05.034282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af9061-ebbd-48c1-aa1e-77239f3fbc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:05.036865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af9061-ebbd-48c1-aa1e-77239f3fbc5c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:05.057946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:05.059241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1125/2207] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:05.076845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99853192-aafe-4e9b-bf13-0c0798205bf1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:05.082226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:05.083169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:05.083776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:05.084227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] PATH_INFO: `/v3/projects/e5f7dbd66d29457f832dd396aa380da0/users/e592cc1b4501423d97af2556ee2d0ff5/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:05.100715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f7dbd66d29457f832dd396aa380da0, user_id=e592cc1b4501423d97af2556ee2d0ff5, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:05.103423 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:05.117683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1083/2208] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:05 2022] PUT /identity/v3/projects/e5f7dbd66d29457f832dd396aa380da0/users/e592cc1b4501423d97af2556ee2d0ff5/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:05.127815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95cced-dd80-45dd-836e-23ce16982420 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:05.128141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95cced-dd80-45dd-836e-23ce16982420 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:05.128439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95cced-dd80-45dd-836e-23ce16982420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:05.177147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7a95cced-dd80-45dd-836e-23ce16982420 None None] MFA Rules not processed for user `e592cc1b4501423d97af2556ee2d0ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:05.178326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7a95cced-dd80-45dd-836e-23ce16982420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:05.217052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:05.251199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1126/2209] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:05.262589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:05.264727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:05.324865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae612234-38a2-471b-b90a-5991eaa4ae2e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:05.328774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa513d-0fbf-44d5-bba1-d9136384c371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:05.329422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa513d-0fbf-44d5-bba1-d9136384c371 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:05.329736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa513d-0fbf-44d5-bba1-d9136384c371 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:05.330015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa513d-0fbf-44d5-bba1-d9136384c371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:05.340644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa513d-0fbf-44d5-bba1-d9136384c371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:05.342117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa513d-0fbf-44d5-bba1-d9136384c371 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:05.354175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1084/2210] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:07.991911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:07.992376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:07.992464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:08.022864 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] MFA Rules not processed for user `8e388fb4942847e1b671e6e6da0a72b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:08.024212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:08.110408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1127/2211] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:08.122627 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f938-b0c8-4ae2-b700-e60884738df5 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:08.123068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f938-b0c8-4ae2-b700-e60884738df5 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:08.123193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4f938-b0c8-4ae2-b700-e60884738df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:08.142973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-59f4f938-b0c8-4ae2-b700-e60884738df5 None None] MFA Rules not processed for user `8e388fb4942847e1b671e6e6da0a72b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:08.144772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-59f4f938-b0c8-4ae2-b700-e60884738df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:08.163290 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1085/2212] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:08.170998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:08.173399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:08.291663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048172-f3c3-4abc-9f51-e8dd004b0f20 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:08.308653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:08.309631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:08.310126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:08.310466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:08.321174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:08.323477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:08.341076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1128/2213] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:09.181475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:09.181917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:09.182114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:09.203482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] MFA Rules not processed for user `8e388fb4942847e1b671e6e6da0a72b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:09.205235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:09.214059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1086/2214] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:14.964940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:14.966429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:15.020447 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:15.034068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084caf-0b1c-4ea1-9c35-6e378e91386d service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:15.039237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:15.040136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:15.040429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:15.040710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] PATH_INFO: `/v3/users/718db532b5f34030b14bb2af95f9b530` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:15.041899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=718db532b5f34030b14bb2af95f9b530)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:15.043849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:15.091976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718db532b5f34030b14bb2af95f9b530'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.099619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718db532b5f34030b14bb2af95f9b530'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.107657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718db532b5f34030b14bb2af95f9b530'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.108320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718db532b5f34030b14bb2af95f9b530'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.108922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718db532b5f34030b14bb2af95f9b530'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.126564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1129/2215] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:14 2022] DELETE /identity/v3/users/718db532b5f34030b14bb2af95f9b530 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:15.316985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:15.351405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ebfa-b764-4157-829b-401d9ea1a0c0 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:15.378171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:15.419313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:15.420265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:15.420540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:15.420823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] PATH_INFO: `/v3/projects/af09b340c00d472fb1de392cf772a3b5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:15.422038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af09b340c00d472fb1de392cf772a3b5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:15.424051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:15.478078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af09b340c00d472fb1de392cf772a3b5', 'request_id': 'req-ba172df5-4513-41c6-b14b-93512127927c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.484504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af09b340c00d472fb1de392cf772a3b5', 'request_id': 'req-ba172df5-4513-41c6-b14b-93512127927c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.491606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af09b340c00d472fb1de392cf772a3b5', 'request_id': 'req-ba172df5-4513-41c6-b14b-93512127927c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.510817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] The token cache is being invalidate because project af09b340c00d472fb1de392cf772a3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:15.510817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.510817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.510817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1087/2216] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:15 2022] DELETE /identity/v3/projects/af09b340c00d472fb1de392cf772a3b5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:15.516303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:15.519158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:15.535970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4876-1749-4188-a64d-987d98cee45f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:15.608615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:15.609491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:15.609782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:15.610071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] PATH_INFO: `/v3/users/b3eea7ff73cd469cbafda78d92c5f64c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:15.611273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3eea7ff73cd469cbafda78d92c5f64c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:15.614049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:15.666766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3eea7ff73cd469cbafda78d92c5f64c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.674010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3eea7ff73cd469cbafda78d92c5f64c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.682388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3eea7ff73cd469cbafda78d92c5f64c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.683228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3eea7ff73cd469cbafda78d92c5f64c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.683962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-08991a8b-91fa-4b4c-acd8-c416bbb9959e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3eea7ff73cd469cbafda78d92c5f64c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:15.693563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:15.710207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1130/2217] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:15 2022] DELETE /identity/v3/users/b3eea7ff73cd469cbafda78d92c5f64c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:15.904149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:15.905639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:15.920644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba172df5-4513-41c6-b14b-93512127927c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:15.989830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:15.990678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:15.990959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:15.991254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] PATH_INFO: `/v3/projects/55b8c61f138a4a97864f3b55406b90a5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:15.992448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b8c61f138a4a97864f3b55406b90a5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:15.994366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.042494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b8c61f138a4a97864f3b55406b90a5', 'request_id': 'req-71c114be-cc78-4353-b0ca-28efa5e8e8ff'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.048586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b8c61f138a4a97864f3b55406b90a5', 'request_id': 'req-71c114be-cc78-4353-b0ca-28efa5e8e8ff'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.049794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:16.057602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b8c61f138a4a97864f3b55406b90a5', 'request_id': 'req-71c114be-cc78-4353-b0ca-28efa5e8e8ff'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.074127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] The token cache is being invalidate because project 55b8c61f138a4a97864f3b55406b90a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:16.074417 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.075046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-71c114be-cc78-4353-b0ca-28efa5e8e8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.076655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1088/2218] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:15 2022] DELETE /identity/v3/projects/55b8c61f138a4a97864f3b55406b90a5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:16.081482 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.081987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.082414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.100614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:16.101823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.161387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1131/2219] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:16.169027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.169329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.169611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.188186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:16.189341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.197507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1089/2220] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:16.201565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.211734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b538e-ae7c-4acb-a43f-71f52210aa14 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.216254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.216927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.217211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.217508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.218234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:16.218539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.220160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.232459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1132/2221] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:29:16.236840 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.246181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d732105-fcc8-49b8-9efc-f1a1e63ce41a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.250833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.251484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.251777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.252096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.252792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.254777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.279959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1090/2222] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:16.284019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.294734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6f04b-7b07-4960-a892-3962d525defd admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.353341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.354138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.354428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.354824 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.355805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.357775 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.382591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1133/2223] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:16.383808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.394958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68ac67-ac35-4236-9f8d-69e6ba7c0a62 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.399599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.400289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.400578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.400857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.401584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.403175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.414235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1091/2224] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:16.418331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.429273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab57fd-337c-48fb-9aee-476cb292a0f1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.433983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803870-c698-4a4e-8299-ac4a65115677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.434636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803870-c698-4a4e-8299-ac4a65115677 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.434952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803870-c698-4a4e-8299-ac4a65115677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.435232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803870-c698-4a4e-8299-ac4a65115677 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.435993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803870-c698-4a4e-8299-ac4a65115677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.437584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803870-c698-4a4e-8299-ac4a65115677 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.449558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1134/2225] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:16.454529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.466726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07c54c-6103-461b-bc87-403191850db5 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.471302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.472247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.472532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.472810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] PATH_INFO: `/v3/projects/8f0976ceec2a4a5facc854ede0531f01/users/20f22831f0b54fbe9d5c8d2bf35a9eed/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.488209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0976ceec2a4a5facc854ede0531f01, user_id=20f22831f0b54fbe9d5c8d2bf35a9eed, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.490928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.504330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1092/2226] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:16 2022] PUT /identity/v3/projects/8f0976ceec2a4a5facc854ede0531f01/users/20f22831f0b54fbe9d5c8d2bf35a9eed/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:16.514873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.515172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.515459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.542523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] MFA Rules not processed for user `20f22831f0b54fbe9d5c8d2bf35a9eed`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:16.543727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.591527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:16.614509 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.616279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.622301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1135/2227] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:16.630259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.631725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.699216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3c8e2-041c-45e4-ab99-dacc68f0b226 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.702944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.703533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.703823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.704133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.707517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bcb44-7bba-4b09-9f97-1825ca9de2c1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.712202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.713069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.713352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.713514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.713631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] PATH_INFO: `/v3/users/e592cc1b4501423d97af2556ee2d0ff5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.714825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e592cc1b4501423d97af2556ee2d0ff5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.714955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.716774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.724387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1136/2228] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:16.746023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.758176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86abb5-a269-4118-ac82-d2cf80c51032 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:16.763120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:16.764112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.764429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.764760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] PATH_INFO: `/v3/users/20f22831f0b54fbe9d5c8d2bf35a9eed` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.766086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f22831f0b54fbe9d5c8d2bf35a9eed)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:16.766922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e592cc1b4501423d97af2556ee2d0ff5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.768154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:16.775584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e592cc1b4501423d97af2556ee2d0ff5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.782691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e592cc1b4501423d97af2556ee2d0ff5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.783339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e592cc1b4501423d97af2556ee2d0ff5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.784001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e783631b-3c6f-4050-b9c7-c81e1bc1fb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e592cc1b4501423d97af2556ee2d0ff5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.815344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1093/2229] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:16 2022] DELETE /identity/v3/users/e592cc1b4501423d97af2556ee2d0ff5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:16.820134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.820134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.820134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.822771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f22831f0b54fbe9d5c8d2bf35a9eed'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.828546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:16.831019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f22831f0b54fbe9d5c8d2bf35a9eed'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.844910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:16.845144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f22831f0b54fbe9d5c8d2bf35a9eed'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.847285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.848317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f22831f0b54fbe9d5c8d2bf35a9eed'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.850554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-363efae0-b439-4088-8101-11da6ef6a45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f22831f0b54fbe9d5c8d2bf35a9eed'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:16.900452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1137/2230] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:16 2022] DELETE /identity/v3/users/20f22831f0b54fbe9d5c8d2bf35a9eed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:16.902515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:16.902827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:16.903309 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:16.935710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:16.937737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:16.969811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1094/2231] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:16.982943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:16.985788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:17.024844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1138/2232] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:17.041880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:17.043641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:17.050183 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:17.119354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb39a6-80a1-4212-9e57-a6bd965b4fb8 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:17.194544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48915cc0-54c8-4975-b904-aaf85afb6207 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:17.210399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:17.212293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:17.212729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:17.213026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:17.223082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74753067-8ccd-4442-aa19-d52cbd83daec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:17.224069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753067-8ccd-4442-aa19-d52cbd83daec service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:17.226734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753067-8ccd-4442-aa19-d52cbd83daec service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:17.227245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74753067-8ccd-4442-aa19-d52cbd83daec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:17.235017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:17.238723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:17.256510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1139/2233] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:17.267654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74753067-8ccd-4442-aa19-d52cbd83daec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:17.272810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74753067-8ccd-4442-aa19-d52cbd83daec service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:17.293462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1095/2234] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:17.890526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:17.892159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:17.912503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178cbdc-9be3-444b-a4c4-d5b3cca040c3 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:17.925910 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:17.927480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:17.927480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:17.927705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] PATH_INFO: `/v3/projects/8f0976ceec2a4a5facc854ede0531f01` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:17.929765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0976ceec2a4a5facc854ede0531f01)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:17.932881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:17.984676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0976ceec2a4a5facc854ede0531f01', 'request_id': 'req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:17.991010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0976ceec2a4a5facc854ede0531f01', 'request_id': 'req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:17.997509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0976ceec2a4a5facc854ede0531f01', 'request_id': 'req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.011424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] The token cache is being invalidate because project 8f0976ceec2a4a5facc854ede0531f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:18.011715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.012485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.014256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1140/2235] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:17 2022] DELETE /identity/v3/projects/8f0976ceec2a4a5facc854ede0531f01 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:18.023179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b8d0-96e0-4aaf-b0d0-a4bbe92c9d90 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.023179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b8d0-96e0-4aaf-b0d0-a4bbe92c9d90 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.023179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b8d0-96e0-4aaf-b0d0-a4bbe92c9d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.024749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.026645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:18.042310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-96a3b8d0-96e0-4aaf-b0d0-a4bbe92c9d90 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:18.043561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-96a3b8d0-96e0-4aaf-b0d0-a4bbe92c9d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:18.100440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e8b2f-6af0-42d9-b311-7d7fae8a4cfc admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.105639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.106498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.106783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.107061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] PATH_INFO: `/v3/projects/e5f7dbd66d29457f832dd396aa380da0` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.108276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f7dbd66d29457f832dd396aa380da0)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.110192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.115171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1096/2236] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:18.122886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.123180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.123461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.132111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:18.145190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:18.146407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:18.148362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:18.165891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f7dbd66d29457f832dd396aa380da0', 'request_id': 'req-45472f6f-556f-42b1-9cb1-90c0c6263969'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.172498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f7dbd66d29457f832dd396aa380da0', 'request_id': 'req-45472f6f-556f-42b1-9cb1-90c0c6263969'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.179647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f7dbd66d29457f832dd396aa380da0', 'request_id': 'req-45472f6f-556f-42b1-9cb1-90c0c6263969'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.195336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] The token cache is being invalidate because project e5f7dbd66d29457f832dd396aa380da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:18.196048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.196510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:18.198144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1141/2237] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:18 2022] DELETE /identity/v3/projects/e5f7dbd66d29457f832dd396aa380da0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:18.218718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1097/2238] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:18.224468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.235957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45472f6f-556f-42b1-9cb1-90c0c6263969 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.242839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.243627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.244099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.244578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.245536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:18.246229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.248739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.262640 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1142/2239] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:18.267057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.277775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ee963-bcc1-4bc5-bccc-f7c55d9be0c9 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.282754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.283441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.283732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.284057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.286050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.288070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.323360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1098/2240] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:18 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:18.325215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.337508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c8314-2e79-4b9c-a0a7-071907ec133b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.407577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.408292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.408584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.408865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.410376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.412424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.437214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1143/2241] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:18 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:18.438085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.453941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f83f9-a213-465e-98f8-e512102b601f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.461380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.462217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.462363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.462579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.463310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.464969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.481599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1099/2242] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:29:18.486340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.499087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b29d15-cfab-425e-b21f-ea6758f1f102 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.504553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc74618-7538-4ad5-b8ab-a99c661228ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.505226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc74618-7538-4ad5-b8ab-a99c661228ed admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.505578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc74618-7538-4ad5-b8ab-a99c661228ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.505784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc74618-7538-4ad5-b8ab-a99c661228ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.506519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc74618-7538-4ad5-b8ab-a99c661228ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.508141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc74618-7538-4ad5-b8ab-a99c661228ed admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.523691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1144/2243] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:18.524901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.537139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b91c2-b18f-4f5a-bb01-1ee75ad4b0c8 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.544694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.545870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.546155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.546460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] PATH_INFO: `/v3/projects/ffe5b0c4dce145ec83c43ca82b7be4f9/users/94bdedab28be49bba5152447b2ea1d86/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.564800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe5b0c4dce145ec83c43ca82b7be4f9, user_id=94bdedab28be49bba5152447b2ea1d86, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.568847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.583226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1100/2244] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:18 2022] PUT /identity/v3/projects/ffe5b0c4dce145ec83c43ca82b7be4f9/users/94bdedab28be49bba5152447b2ea1d86/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:18.594430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.594731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.595019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.630656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] MFA Rules not processed for user `94bdedab28be49bba5152447b2ea1d86`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:18.632261 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:18.710665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1145/2245] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:18.721276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:18.723481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:18.785930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94605c-27d0-4422-b8e5-5bfd01bb17cd admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:18.789590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164f1b4-03a5-4656-954a-2bb523d858b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:18.790233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164f1b4-03a5-4656-954a-2bb523d858b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:18.790519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164f1b4-03a5-4656-954a-2bb523d858b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:18.790798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164f1b4-03a5-4656-954a-2bb523d858b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:18.799035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164f1b4-03a5-4656-954a-2bb523d858b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:18.801507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164f1b4-03a5-4656-954a-2bb523d858b3 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:18.810745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1101/2246] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:21.794410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:21.807663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:21.862203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4382d-ce38-4d21-8293-5538c165aed7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:21.867734 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:21.868631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:21.868915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:21.869192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] PATH_INFO: `/v3/users/94bdedab28be49bba5152447b2ea1d86` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:21.870381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=94bdedab28be49bba5152447b2ea1d86)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:21.872341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:21.918637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94bdedab28be49bba5152447b2ea1d86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:21.925851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94bdedab28be49bba5152447b2ea1d86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:21.932567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94bdedab28be49bba5152447b2ea1d86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:21.933185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94bdedab28be49bba5152447b2ea1d86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:21.933796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94bdedab28be49bba5152447b2ea1d86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:21.951754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1146/2247] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:21 2022] DELETE /identity/v3/users/94bdedab28be49bba5152447b2ea1d86 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:21.956036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:21.957214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:21.957376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:21.982329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:21.983725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:22.041127 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:22.080836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1102/2248] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:22.091515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:22.093108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:22.160129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f11b71-9628-4f6e-8680-57c7c72836ab admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:22.164198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc9a7-736c-40c8-9908-13ef94596e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:22.164869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc9a7-736c-40c8-9908-13ef94596e04 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.165161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc9a7-736c-40c8-9908-13ef94596e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.165443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc9a7-736c-40c8-9908-13ef94596e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.175208 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc9a7-736c-40c8-9908-13ef94596e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:22.177406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc9a7-736c-40c8-9908-13ef94596e04 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:22.187164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1147/2249] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:22.553951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:22.555484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:22.569931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef89971-a081-4dab-acd2-2419495d5ced None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:22.574755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:22.575648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.576695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.577319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] PATH_INFO: `/v3/projects/ffe5b0c4dce145ec83c43ca82b7be4f9` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.578564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe5b0c4dce145ec83c43ca82b7be4f9)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:22.580660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:22.629769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe5b0c4dce145ec83c43ca82b7be4f9', 'request_id': 'req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:22.636117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe5b0c4dce145ec83c43ca82b7be4f9', 'request_id': 'req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:22.642431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe5b0c4dce145ec83c43ca82b7be4f9', 'request_id': 'req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:22.655056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] The token cache is being invalidate because project ffe5b0c4dce145ec83c43ca82b7be4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:22.655351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:22.656054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-f3b9d8cc-e68a-420d-aa80-7aa8607ecda4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:22.657605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1103/2250] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:22 2022] DELETE /identity/v3/projects/ffe5b0c4dce145ec83c43ca82b7be4f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:22.663045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.663342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.663629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.681098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:22.682221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:22.715809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:22.746287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1148/2251] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:22.754274 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.754586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.754869 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.773538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:22.774756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:22.782710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1104/2252] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:22.787032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:22.796477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a63c62-ed31-4c0a-ba06-275edff9fa47 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:22.801162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:22.801816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.802098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.802375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.803091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:22.803395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:22.805011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:22.817485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1149/2253] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:29:22.821745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:22.831010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658f805-aa44-4358-acb4-b83b4b539bcb None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:22.836519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:22.837170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.837463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.837750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.838462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:22.840403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:22.870372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1105/2254] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:22 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:22.872446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:22.883075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99683f-baf2-4b49-9904-6546d0ebf271 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:22.943425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:22.944043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.944333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.944638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.945319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:22.947263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:22.966214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1150/2255] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:22 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:29:22.970272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:22.980636 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39477476-a619-450a-a81a-880a0acfde98 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:22.985235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:22.985913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:22.986172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:22.986449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:22.987172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:22.989381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:22.999604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1106/2256] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:23.004694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:23.015126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674868-8c95-4cb4-b24a-d28d8a6cfd3d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:23.019865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d241-be16-4239-9a03-509bff851903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:23.020544 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d241-be16-4239-9a03-509bff851903 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.020830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d241-be16-4239-9a03-509bff851903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.021110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d241-be16-4239-9a03-509bff851903 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.021836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d241-be16-4239-9a03-509bff851903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:23.023426 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d241-be16-4239-9a03-509bff851903 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:23.033291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1151/2257] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:23.037464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:23.047341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8949-97a7-45b2-b844-13ccf1d995c8 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:23.052797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:23.053678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.054060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.054224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] PATH_INFO: `/v3/projects/417679f5534745beb8e1168bf427021a/users/e94175fca35e4e4596bb0d5e026499a1/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.070125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417679f5534745beb8e1168bf427021a, user_id=e94175fca35e4e4596bb0d5e026499a1, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:23.072831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:23.085388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1107/2258] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:23 2022] PUT /identity/v3/projects/417679f5534745beb8e1168bf427021a/users/e94175fca35e4e4596bb0d5e026499a1/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:23.095667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.095997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.096281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.123573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] MFA Rules not processed for user `e94175fca35e4e4596bb0d5e026499a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:23.124929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:23.125989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:23.127713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:23.200248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1152/2259] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:23.211308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:23.212700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:23.221169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620b7f-5446-4731-a8ce-764d1cda2c66 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:23.226747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:23.227823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.228143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.228458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] PATH_INFO: `/v3/users/9003ed19b96947a799d21a1cbd5b6177` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.229687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9003ed19b96947a799d21a1cbd5b6177)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:23.232094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:23.243526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:23.251111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:23.279050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d842067-f8ff-4c0b-b199-f137ac3111ce None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:23.283148 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086d88d-2ce0-435a-a609-0ed49cc2fa0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:23.283832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d88d-2ce0-435a-a609-0ed49cc2fa0f service glance] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.284147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d88d-2ce0-435a-a609-0ed49cc2fa0f service glance] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.284971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d88d-2ce0-435a-a609-0ed49cc2fa0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.286950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9003ed19b96947a799d21a1cbd5b6177'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.293654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086d88d-2ce0-435a-a609-0ed49cc2fa0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:23.294205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9003ed19b96947a799d21a1cbd5b6177'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.295209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086d88d-2ce0-435a-a609-0ed49cc2fa0f service glance] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:23.302519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9003ed19b96947a799d21a1cbd5b6177'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.303245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9003ed19b96947a799d21a1cbd5b6177'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.304121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9003ed19b96947a799d21a1cbd5b6177'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.305508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1153/2260] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:23.322239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1108/2261] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:23 2022] DELETE /identity/v3/users/9003ed19b96947a799d21a1cbd5b6177 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:23.328538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.328851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.329149 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.347472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:23.349373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:23.420457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1154/2262] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:23.428230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:23.429905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:23.497135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90d31f-ebb1-4a0e-8a57-d4ff69ef05c0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:23.500909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a9d38-8947-45b2-a5c5-75211848352e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:23.501718 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a9d38-8947-45b2-a5c5-75211848352e service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.502039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a9d38-8947-45b2-a5c5-75211848352e service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.502298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a9d38-8947-45b2-a5c5-75211848352e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.514373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a9d38-8947-45b2-a5c5-75211848352e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:23.515818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a9d38-8947-45b2-a5c5-75211848352e service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:23.527195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1109/2263] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:23.844477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:23.846185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:23.866330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779e62-caba-4221-b674-f898573a58c8 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:23.879141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:23.880258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.880636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.881078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] PATH_INFO: `/v3/projects/7492df6834fc4068b27f3fd2ac4c3900` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.882237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7492df6834fc4068b27f3fd2ac4c3900)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:23.884568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:23.939248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7492df6834fc4068b27f3fd2ac4c3900', 'request_id': 'req-22ce2cae-9ed8-41b4-a749-347ad3339dba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.946002 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7492df6834fc4068b27f3fd2ac4c3900', 'request_id': 'req-22ce2cae-9ed8-41b4-a749-347ad3339dba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.952921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7492df6834fc4068b27f3fd2ac4c3900', 'request_id': 'req-22ce2cae-9ed8-41b4-a749-347ad3339dba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.967758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] The token cache is being invalidate because project 7492df6834fc4068b27f3fd2ac4c3900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:23.968093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.970042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-22ce2cae-9ed8-41b4-a749-347ad3339dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:23.971617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1155/2264] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:23 2022] DELETE /identity/v3/projects/7492df6834fc4068b27f3fd2ac4c3900 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:23.976725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:23.977195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:23.977440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:23.997222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:23.998523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:24.067963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1110/2265] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:24.075750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.076075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.076364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.096562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:24.098453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:24.107154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1156/2266] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:24.111557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.122071 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73415c-b480-42d6-8cbe-9ef641d3334f None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.126614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.127309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.127595 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.128021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.128945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:24.129254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.130854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.143928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1111/2267] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:24.148655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.158111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98f761-d842-416e-8a44-27125ec10bdd None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.164204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.164875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.165187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.165481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.166331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.168379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.197601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1157/2268] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:24 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:24.201721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.211733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e45a-2988-4cc0-ab29-813afa5cae50 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.228405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:24.288217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.289195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.289607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.289955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.290972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.293430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.317638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1112/2269] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:24 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:24.321759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.333036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462348a6-dc35-4bd8-bdeb-1ce05b003d0b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.337718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.338377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.338661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.338939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.339672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.341314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.354004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1158/2270] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:24.358306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.369405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b43c15-5b32-4d4a-b4a2-62881accb917 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.375155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644d7e0-f210-4274-a22d-6c710ccbfc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.376041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644d7e0-f210-4274-a22d-6c710ccbfc1b admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.376405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644d7e0-f210-4274-a22d-6c710ccbfc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.376750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644d7e0-f210-4274-a22d-6c710ccbfc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.377550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644d7e0-f210-4274-a22d-6c710ccbfc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.379199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644d7e0-f210-4274-a22d-6c710ccbfc1b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.389835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1113/2271] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:24.394750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.404766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ac9e7-5ccf-495f-9064-b1132d3ef997 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.409753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.411152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.411436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.411750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] PATH_INFO: `/v3/projects/ee674fcc546245e3b2299ceeed418b7d/users/6ea568dee76d43aa8a94d55229dc8987/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.427173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee674fcc546245e3b2299ceeed418b7d, user_id=6ea568dee76d43aa8a94d55229dc8987, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.429874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.432105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:24.444645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1159/2272] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:24 2022] PUT /identity/v3/projects/ee674fcc546245e3b2299ceeed418b7d/users/6ea568dee76d43aa8a94d55229dc8987/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:24.457571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.457865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.458151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.484861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] MFA Rules not processed for user `6ea568dee76d43aa8a94d55229dc8987`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:24.486057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:24.557876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1114/2273] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:24.571577 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:24.573521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:24.634496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa36d8-ab28-40df-8c7e-c972c16378f6 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:24.638836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a812b9-31ae-497b-b319-6d341e25a37f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:24.639632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a812b9-31ae-497b-b319-6d341e25a37f service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:24.639975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a812b9-31ae-497b-b319-6d341e25a37f service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:24.640376 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a812b9-31ae-497b-b319-6d341e25a37f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:24.651230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a812b9-31ae-497b-b319-6d341e25a37f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:24.652701 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a812b9-31ae-497b-b319-6d341e25a37f service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:24.662600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1160/2274] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:27.345366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:27.347083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:27.417492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990acb2b-5cfe-4eb2-a9de-47337c78a42a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:27.422419 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:27.423471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:27.424336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:27.424336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] PATH_INFO: `/v3/users/af38f9b39b3c4f71b619b8b599d6d6a4` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:27.426281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af38f9b39b3c4f71b619b8b599d6d6a4)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:27.428099 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:27.458927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:27.500108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af38f9b39b3c4f71b619b8b599d6d6a4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:27.508283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af38f9b39b3c4f71b619b8b599d6d6a4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:27.515351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af38f9b39b3c4f71b619b8b599d6d6a4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:27.516072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af38f9b39b3c4f71b619b8b599d6d6a4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:27.516684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af38f9b39b3c4f71b619b8b599d6d6a4'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:27.543635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1115/2275] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:27 2022] DELETE /identity/v3/users/af38f9b39b3c4f71b619b8b599d6d6a4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:27.548471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:27.548943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:27.549093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:27.569221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:27.570681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:27.657412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1161/2276] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:27.669069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:27.671232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:27.751058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d9e9-c9fa-4791-87e1-b70f138c6f44 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:27.758573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed573cb-e75e-4d84-b55c-c480e89936a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:27.759247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed573cb-e75e-4d84-b55c-c480e89936a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:27.760150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed573cb-e75e-4d84-b55c-c480e89936a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:27.760150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed573cb-e75e-4d84-b55c-c480e89936a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:27.771432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed573cb-e75e-4d84-b55c-c480e89936a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:27.773041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed573cb-e75e-4d84-b55c-c480e89936a0 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:27.783202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1116/2277] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:28.160387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.164241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:28.178521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a548f-c015-4c73-9ce0-e5202446d479 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.183315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.184203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.184494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.184792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] PATH_INFO: `/v3/projects/06e75b054fd14b77b20591f8c078fdf8` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.185967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e75b054fd14b77b20591f8c078fdf8)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.187900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.242679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e75b054fd14b77b20591f8c078fdf8', 'request_id': 'req-1c281287-0926-4a49-9d4a-fbe0a010d5ba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:28.248158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e75b054fd14b77b20591f8c078fdf8', 'request_id': 'req-1c281287-0926-4a49-9d4a-fbe0a010d5ba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:28.255021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e75b054fd14b77b20591f8c078fdf8', 'request_id': 'req-1c281287-0926-4a49-9d4a-fbe0a010d5ba'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:28.267805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] The token cache is being invalidate because project 06e75b054fd14b77b20591f8c078fdf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:28.268224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:28.269189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1c281287-0926-4a49-9d4a-fbe0a010d5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:28.270765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1162/2278] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:28 2022] DELETE /identity/v3/projects/06e75b054fd14b77b20591f8c078fdf8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:28.275942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.276242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.276531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.294055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:28.295326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:28.357456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1117/2279] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:28.366550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.366845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.367128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.385999 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:28.387216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:28.396140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1163/2280] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:28.400388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.410868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362bdd9-3c06-4d24-bd83-b2c8381dc0cf None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.415500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.416226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.416518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.416805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.417538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:28.417854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.419451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.431783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1118/2281] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:28.435756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.445470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa105e-e916-4831-9a89-a74e60f44442 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.450195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.450849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.451139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.451424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.452205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.454124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.464743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:28.489154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1164/2282] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:28 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:28.490765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.501495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eae05-fea3-47ce-901c-673ddaa16dba admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.537921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:28.568505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.569181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.569468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.569750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.570442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.572387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.594635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1119/2283] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:28 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:29:28.599534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.610658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddf943-6392-46be-9699-bcfd8f788f1b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.616199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.616943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.617319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.617670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.618468 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.620170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.634374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1165/2284] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:28.638672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.650357 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f55971-db03-4729-bdf6-a20026feab55 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.655211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9cfef-96c4-4f42-9b85-c79d76c2b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.655896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9cfef-96c4-4f42-9b85-c79d76c2b370 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.656197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9cfef-96c4-4f42-9b85-c79d76c2b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.656482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9cfef-96c4-4f42-9b85-c79d76c2b370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.657219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9cfef-96c4-4f42-9b85-c79d76c2b370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.658872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9cfef-96c4-4f42-9b85-c79d76c2b370 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.671098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1120/2285] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:28.675863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.685951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5a086-bed1-47a6-90b1-28071ab16d60 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.690970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.692385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.692671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.692954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] PATH_INFO: `/v3/projects/7a81fff84b3d4719a96ff575de5c0720/users/1bfd2494a0ca409bb132a0aa682da8f5/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.708882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a81fff84b3d4719a96ff575de5c0720, user_id=1bfd2494a0ca409bb132a0aa682da8f5, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.711972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.725178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1166/2286] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:28 2022] PUT /identity/v3/projects/7a81fff84b3d4719a96ff575de5c0720/users/1bfd2494a0ca409bb132a0aa682da8f5/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:28.735855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.737594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.737921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.764826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] MFA Rules not processed for user `1bfd2494a0ca409bb132a0aa682da8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:28.766037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:28.845465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1121/2287] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:28.860273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:28.864191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:28.923807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f520d-feee-4bcb-b4f5-5c30f709d8bf admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:28.927767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22a66a-6248-4695-bc2a-ac62a9bb14b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:28.928481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22a66a-6248-4695-bc2a-ac62a9bb14b1 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:28.928764 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22a66a-6248-4695-bc2a-ac62a9bb14b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:28.929046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22a66a-6248-4695-bc2a-ac62a9bb14b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:28.937861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22a66a-6248-4695-bc2a-ac62a9bb14b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:28.939395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22a66a-6248-4695-bc2a-ac62a9bb14b1 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:28.948991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1167/2288] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:38.841679 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:38.944623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:44.570944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:44.635503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79a3f-261d-48eb-b72f-ac0f29876135 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:44.640135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:44.640944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:44.641228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:44.641505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] PATH_INFO: `/v3/users/1bfd2494a0ca409bb132a0aa682da8f5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:44.642703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bfd2494a0ca409bb132a0aa682da8f5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:44.645414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:44.692737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bfd2494a0ca409bb132a0aa682da8f5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:44.700160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bfd2494a0ca409bb132a0aa682da8f5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:44.707818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bfd2494a0ca409bb132a0aa682da8f5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:44.708489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bfd2494a0ca409bb132a0aa682da8f5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:44.709107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bfd2494a0ca409bb132a0aa682da8f5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:44.727301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1122/2289] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:44 2022] DELETE /identity/v3/users/1bfd2494a0ca409bb132a0aa682da8f5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:44.732237 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:44.732746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:44.732856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:44.749704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:44.750902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:44.809825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1168/2290] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:44.819944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:44.821405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:44.889776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321b8d-a4f3-487f-9509-f8a8f6ab1e06 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:44.893301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1d967-dee3-48b6-9f07-bd0044ef8341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:44.894467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d967-dee3-48b6-9f07-bd0044ef8341 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:44.894751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d967-dee3-48b6-9f07-bd0044ef8341 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:44.895031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1d967-dee3-48b6-9f07-bd0044ef8341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:44.905200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d967-dee3-48b6-9f07-bd0044ef8341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:44.906637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1d967-dee3-48b6-9f07-bd0044ef8341 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:44.916880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1123/2291] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:45.196827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.203603 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:45.216599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fa92c-ee11-48a5-b41f-4701337010b9 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.221916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.224494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.224886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.225604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] PATH_INFO: `/v3/projects/7a81fff84b3d4719a96ff575de5c0720` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.226751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a81fff84b3d4719a96ff575de5c0720)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.228740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.281596 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a81fff84b3d4719a96ff575de5c0720', 'request_id': 'req-29cedbf1-fd3c-4a23-810c-35246e197409'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:45.288319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a81fff84b3d4719a96ff575de5c0720', 'request_id': 'req-29cedbf1-fd3c-4a23-810c-35246e197409'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:45.294659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a81fff84b3d4719a96ff575de5c0720', 'request_id': 'req-29cedbf1-fd3c-4a23-810c-35246e197409'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:45.306390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] The token cache is being invalidate because project 7a81fff84b3d4719a96ff575de5c0720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:45.306658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:45.307268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-29cedbf1-fd3c-4a23-810c-35246e197409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:45.309934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1169/2292] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:45 2022] DELETE /identity/v3/projects/7a81fff84b3d4719a96ff575de5c0720 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:45.316368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.316771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.317169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.336273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:45.337566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:45.364971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:45.412064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1124/2293] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:45.425621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.426178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.426511 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.449522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:45.450784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:45.458756 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1170/2294] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:45.463729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.474148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656914ea-aa7d-4a05-94ad-53ea55ee9233 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.479122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.479992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.483155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.483512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.484342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:45.484663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.486347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.499591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1125/2295] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:45.504414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.514959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9b28-5843-40ec-929c-b7417a164131 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.520442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.521105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.521390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.521667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.522354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.524434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.553654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1171/2296] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:45 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:45.558050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.569508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf74be8-6499-4f59-a833-3feab6bdf3b0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.630084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.630742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.631022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.631296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.632009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.633919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.658001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1126/2297] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:45 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:45.662674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.673558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b7c5-ead2-4aaf-a170-65b44bdb295e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.679137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.679853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.680185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.680476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.681218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.682849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.694361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1172/2298] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:45.698481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.708523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae112e-90d5-4025-bda8-429093e68f58 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.713215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f27615-6b85-4409-b963-ea09b6022fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.713881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f27615-6b85-4409-b963-ea09b6022fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.714168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f27615-6b85-4409-b963-ea09b6022fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.714447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f27615-6b85-4409-b963-ea09b6022fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.715192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f27615-6b85-4409-b963-ea09b6022fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.716855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f27615-6b85-4409-b963-ea09b6022fb3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.728047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1127/2299] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:45.732580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.743291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d5e22-77d0-42c3-9c37-18d29892d033 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.747926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.748803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.749089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.749371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] PATH_INFO: `/v3/projects/8ed739452b364c06a1244023c3c132c5/users/8f6df55faf974dcb8104db20adada8e0/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.764470 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed739452b364c06a1244023c3c132c5, user_id=8f6df55faf974dcb8104db20adada8e0, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.767133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.779850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1173/2300] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:45 2022] PUT /identity/v3/projects/8ed739452b364c06a1244023c3c132c5/users/8f6df55faf974dcb8104db20adada8e0/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:45.790628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752997-585e-40d7-a080-83645cee29dc None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.790944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752997-585e-40d7-a080-83645cee29dc None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.791226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752997-585e-40d7-a080-83645cee29dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.820454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b1752997-585e-40d7-a080-83645cee29dc None None] MFA Rules not processed for user `8f6df55faf974dcb8104db20adada8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:45.821699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b1752997-585e-40d7-a080-83645cee29dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:45.898609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1128/2301] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:45.906047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:45.907752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:45.937399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:45.971365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c28aa-3221-44a2-9b9b-e06052f58fb3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:45.976248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663074-d220-4101-8c3a-a39aec59af5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:45.976898 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663074-d220-4101-8c3a-a39aec59af5a service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:45.977188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663074-d220-4101-8c3a-a39aec59af5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:45.977473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663074-d220-4101-8c3a-a39aec59af5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:45.986033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da663074-d220-4101-8c3a-a39aec59af5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:45.988643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da663074-d220-4101-8c3a-a39aec59af5a service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:45.997415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1174/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:48.544307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1752997-585e-40d7-a080-83645cee29dc None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:48.567471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:48.614136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1752997-585e-40d7-a080-83645cee29dc None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:48.618708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:48.619580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:48.619867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:48.620184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] PATH_INFO: `/v3/users/8f6df55faf974dcb8104db20adada8e0` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:48.621372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6df55faf974dcb8104db20adada8e0)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:48.623301 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:48.671464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6df55faf974dcb8104db20adada8e0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:48.679335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6df55faf974dcb8104db20adada8e0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:48.686792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6df55faf974dcb8104db20adada8e0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:48.687732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6df55faf974dcb8104db20adada8e0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:48.688630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6df55faf974dcb8104db20adada8e0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:48.706942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1129/2303] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:48 2022] DELETE /identity/v3/users/8f6df55faf974dcb8104db20adada8e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:48.711438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:48.711953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:48.712065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:48.729901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:48.731352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:48.793221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1175/2304] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:48.804156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:48.805579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:48.867175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcf71e-cb4e-4d7d-ac82-ce7fe02cfd77 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:48.871354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ea845-0566-4346-bf11-7d8ca47fd278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:48.873642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ea845-0566-4346-bf11-7d8ca47fd278 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:48.873932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ea845-0566-4346-bf11-7d8ca47fd278 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:48.874221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ea845-0566-4346-bf11-7d8ca47fd278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:48.884378 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ea845-0566-4346-bf11-7d8ca47fd278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:48.885808 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ea845-0566-4346-bf11-7d8ca47fd278 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:48.895978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1130/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:49.183561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.185046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:49.197817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fbbb8-e9e1-476c-a48b-9704a1e06f2f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.202710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.204494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.205145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.205431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] PATH_INFO: `/v3/projects/8ed739452b364c06a1244023c3c132c5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.208634 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed739452b364c06a1244023c3c132c5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.210341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.273837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed739452b364c06a1244023c3c132c5', 'request_id': 'req-ea2e27d6-7c95-4989-934a-f8f1b6634df3'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:49.280024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed739452b364c06a1244023c3c132c5', 'request_id': 'req-ea2e27d6-7c95-4989-934a-f8f1b6634df3'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:49.286844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed739452b364c06a1244023c3c132c5', 'request_id': 'req-ea2e27d6-7c95-4989-934a-f8f1b6634df3'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:49.300408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] The token cache is being invalidate because project 8ed739452b364c06a1244023c3c132c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:49.300670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:49.301375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-ea2e27d6-7c95-4989-934a-f8f1b6634df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:49.308479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.308736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1176/2306] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:49 2022] DELETE /identity/v3/projects/8ed739452b364c06a1244023c3c132c5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:49.308965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.309346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.328406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:49.329683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:49.368665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:49.400747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1131/2307] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:49.408675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.409562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.409854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.428953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:49.430153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:49.438525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1177/2308] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:49.442907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.454087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d29775-b0eb-43b4-8a85-e38c64e99220 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.461945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.462669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.463000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.463323 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.464161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:49.464567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.466247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.479030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1132/2309] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:29:49.483778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.496573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d41ad-4ada-45e9-92a9-3d89c3643508 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.501716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.502347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.503233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.503549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.504459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.506424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.552026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1178/2310] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:49 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:49.554882 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.573585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90048907-8ff3-4a32-be7d-206afbb7291c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.642404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.643033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.643972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.644420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.645133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.647091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.673113 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1133/2311] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:49 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:49.677598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.688170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1dddd-6fc3-49f0-91e0-2c921d92bff1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.694728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.695497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.695831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.696199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.696944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.698758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.710413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1179/2312] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:49.714370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.725184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dacdfb-c023-499b-806b-0442452145e4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.730066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d942e6e-65b9-4351-92b5-f6f2d8623a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.730973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942e6e-65b9-4351-92b5-f6f2d8623a99 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.731264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942e6e-65b9-4351-92b5-f6f2d8623a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.731552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942e6e-65b9-4351-92b5-f6f2d8623a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.732373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942e6e-65b9-4351-92b5-f6f2d8623a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.734002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942e6e-65b9-4351-92b5-f6f2d8623a99 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.744952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1134/2313] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:49.748912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.759419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd515e3-b329-4cd2-b219-c4559676ca58 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.764137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.765013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.765303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.765586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] PATH_INFO: `/v3/projects/9f46c2ebfa5d4d90b4bc640c0c44daa1/users/b5fca77cf7b34fa89bb37048cc44eb86/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.767786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:49.784473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f46c2ebfa5d4d90b4bc640c0c44daa1, user_id=b5fca77cf7b34fa89bb37048cc44eb86, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.786936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.800607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1180/2314] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:49 2022] PUT /identity/v3/projects/9f46c2ebfa5d4d90b4bc640c0c44daa1/users/b5fca77cf7b34fa89bb37048cc44eb86/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:49.805686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911d62-4c03-4aaf-a2ff-bc643fbaf583 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.805986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911d62-4c03-4aaf-a2ff-bc643fbaf583 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.806269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33911d62-4c03-4aaf-a2ff-bc643fbaf583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.824647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-33911d62-4c03-4aaf-a2ff-bc643fbaf583 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:49.825851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-33911d62-4c03-4aaf-a2ff-bc643fbaf583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:49.887955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1135/2315] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:49.899089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:49.900778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:49.956872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8044ab-8cec-45aa-81bf-f196ed09f8c2 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:49.960719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:49.961380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:49.961670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:49.961980 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:49.971757 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:49.973430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:49.983161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1181/2316] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:54.251147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.251625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.251715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.280702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] MFA Rules not processed for user `b5fca77cf7b34fa89bb37048cc44eb86`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:54.281927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:54.347251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:54.402969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1136/2317] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:54.408469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.419367 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bc0a1-b89b-43e6-9014-ce91d6cbd82e service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.424313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.425612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.425903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.426193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.426895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.428857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.459637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1182/2318] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:54.465047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.477860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11aad-a869-4dee-b64c-798ad9822a4d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.540314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.540999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.541288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.541567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.542268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.544262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.566746 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1137/2319] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:29:54.571044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.582977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb696b-7e8d-4ec2-8a7f-4d064be637f4 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.587795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.588504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.588796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.589078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.589822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.591439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.603649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1183/2320] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:54.608277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.619233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf55b64-bd02-4984-bdd3-8eec0ac316b0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.624432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.625341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.625634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.625947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] PATH_INFO: `/v3/projects/5d447f52ac3c40d59bf8cec7b5a05467/users/59895837b0fa418787f8ec792e8a6616/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.646956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d447f52ac3c40d59bf8cec7b5a05467, user_id=59895837b0fa418787f8ec792e8a6616, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.649097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.665273 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1138/2321] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:54 2022] PUT /identity/v3/projects/5d447f52ac3c40d59bf8cec7b5a05467/users/59895837b0fa418787f8ec792e8a6616/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:54.668582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.680093 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aeba2-2b67-4280-b3c3-d88027601b32 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.753279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.753907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.754198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.754512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.755528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.757265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.769903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1184/2322] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:54.774949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.803300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18ea4-702c-4362-bc26-33fd0aeca234 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.808587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb5802-e993-463c-a600-9afcef3550af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.810652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb5802-e993-463c-a600-9afcef3550af admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.810955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb5802-e993-463c-a600-9afcef3550af admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.811241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb5802-e993-463c-a600-9afcef3550af admin admin] PATH_INFO: `/v3/projects/5d447f52ac3c40d59bf8cec7b5a05467/users/59895837b0fa418787f8ec792e8a6616/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.813346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb5802-e993-463c-a600-9afcef3550af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d447f52ac3c40d59bf8cec7b5a05467, user_id=59895837b0fa418787f8ec792e8a6616, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.816837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb5802-e993-463c-a600-9afcef3550af admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.828235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1139/2323] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:54 2022] PUT /identity/v3/projects/5d447f52ac3c40d59bf8cec7b5a05467/users/59895837b0fa418787f8ec792e8a6616/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:57.773117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:57.777354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:57.799642 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f3d3b-64bb-4220-bf2a-dcf3b1f8ec97 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:57.863594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:57.879804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:57.880739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:57.881024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:57.881304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] PATH_INFO: `/v3/users/e94175fca35e4e4596bb0d5e026499a1` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:57.882783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94175fca35e4e4596bb0d5e026499a1)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:57.885226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:57.949475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94175fca35e4e4596bb0d5e026499a1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:57.961083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94175fca35e4e4596bb0d5e026499a1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:57.970904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94175fca35e4e4596bb0d5e026499a1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:57.972845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94175fca35e4e4596bb0d5e026499a1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:57.973361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94175fca35e4e4596bb0d5e026499a1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.001011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1185/2324] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:57 2022] DELETE /identity/v3/users/e94175fca35e4e4596bb0d5e026499a1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:58.006545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.007471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.008003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.041172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:58.042938 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:58.140905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1140/2325] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:58.143676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.146228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:58.248202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067465c-9fef-4772-aea1-9f15c847400d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.253172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3449970-7359-4e8d-8fef-d3340a15c807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.253700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3449970-7359-4e8d-8fef-d3340a15c807 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.253992 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3449970-7359-4e8d-8fef-d3340a15c807 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.254275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3449970-7359-4e8d-8fef-d3340a15c807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.269615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3449970-7359-4e8d-8fef-d3340a15c807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.270784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3449970-7359-4e8d-8fef-d3340a15c807 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.285294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1186/2326] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:58.697668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.699252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:58.731327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de956fa-44e0-4870-97ec-afb8f92a5a7b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.740990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.742752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.742752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.742970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] PATH_INFO: `/v3/projects/417679f5534745beb8e1168bf427021a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.745164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417679f5534745beb8e1168bf427021a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.747339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.799850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:58.853837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417679f5534745beb8e1168bf427021a', 'request_id': 'req-62c30647-ecd6-462d-b386-9dbca08297a9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.860724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417679f5534745beb8e1168bf427021a', 'request_id': 'req-62c30647-ecd6-462d-b386-9dbca08297a9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.873645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417679f5534745beb8e1168bf427021a', 'request_id': 'req-62c30647-ecd6-462d-b386-9dbca08297a9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.898250 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] The token cache is being invalidate because project 417679f5534745beb8e1168bf427021a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:58.899864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.900967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-62c30647-ecd6-462d-b386-9dbca08297a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.903657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1141/2327] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:58 2022] DELETE /identity/v3/projects/417679f5534745beb8e1168bf427021a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:58.910019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.910491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.911154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.940659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:58.942731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.078684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.079174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.079269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.081885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1187/2328] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:59.108380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:59.110004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.125684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.133485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1142/2329] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:59.138854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200e3f-ecc2-4ba3-a2a2-63420be57c8a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.146295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.146592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.147038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.147390 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.148236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:59.148612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.150731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.165748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:59.177849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.188254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22691b-77f2-4d94-8216-1e4f8cc4f111 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.189539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1188/2330] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:59.199281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.200080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.200435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.200780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.201823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.204006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.244483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.253865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1143/2331] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:59.267218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0a04a-f059-45b1-897e-97b50e6a4d4c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.354805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.355672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.355996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.356284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.357024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.358973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.383849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1189/2332] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:59.387207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.398148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6ed2b-35cc-4353-a3ee-8a664ea2875c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.406548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.407484 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.407784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.408104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.409346 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.410971 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.423634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1144/2333] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:59.428281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.439104 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f5601-eb18-451a-a0c6-05e181cc62cb admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.444553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff410478-ca48-4392-af6b-54fa8f059ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.445337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff410478-ca48-4392-af6b-54fa8f059ded admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.445720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff410478-ca48-4392-af6b-54fa8f059ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.446067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff410478-ca48-4392-af6b-54fa8f059ded admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.446873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff410478-ca48-4392-af6b-54fa8f059ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.448600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff410478-ca48-4392-af6b-54fa8f059ded admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.464075 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1190/2334] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:59.465573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.478916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8baca-c43c-478c-9d75-e0466d96680d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.486306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.490100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.490396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.490680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] PATH_INFO: `/v3/projects/adbb0bdf448f45b28f63131ad9876016/users/c9f8a2db2828478287d356552f3cec10/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.509888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbb0bdf448f45b28f63131ad9876016, user_id=c9f8a2db2828478287d356552f3cec10, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.512750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.532065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1145/2335] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:59 2022] PUT /identity/v3/projects/adbb0bdf448f45b28f63131ad9876016/users/c9f8a2db2828478287d356552f3cec10/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:59.533849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b2d1-598b-4812-85d3-58c6dbb9aff2 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.534976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b2d1-598b-4812-85d3-58c6dbb9aff2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.535265 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b2d1-598b-4812-85d3-58c6dbb9aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.556220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-90d9b2d1-598b-4812-85d3-58c6dbb9aff2 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:59.557305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-90d9b2d1-598b-4812-85d3-58c6dbb9aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.631451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1191/2336] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:59.641602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.644100 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.713085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f925cf-a708-4ee0-a9e3-d72e3ece0d58 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.718795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.719742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.720733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.721601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.734732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.736570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.753307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1146/2337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:30:00.017457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8325d-f85a-47c9-bcb7-439d212c7e22 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.018143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8325d-f85a-47c9-bcb7-439d212c7e22 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.019286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8325d-f85a-47c9-bcb7-439d212c7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.060641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-82b8325d-f85a-47c9-bcb7-439d212c7e22 None None] MFA Rules not processed for user `59895837b0fa418787f8ec792e8a6616`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:00.062287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-82b8325d-f85a-47c9-bcb7-439d212c7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.165058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1192/2338] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:00.180137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.182227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.246880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.281184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fe4f6-6114-49bf-b397-7b71b0c76741 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.288907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.289581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.289872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.290204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.292221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.395120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.396933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.407169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1147/2339] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:00.609034 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41e84-5f07-4336-9cb0-421f8af650d0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.609377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41e84-5f07-4336-9cb0-421f8af650d0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.609897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41e84-5f07-4336-9cb0-421f8af650d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.620599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.673989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8ba41e84-5f07-4336-9cb0-421f8af650d0 None None] MFA Rules not processed for user `c9f8a2db2828478287d356552f3cec10`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:00.676661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8ba41e84-5f07-4336-9cb0-421f8af650d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.771739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1193/2340] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:00.787049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.788814 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.937115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a09cd-90af-45ff-aac1-35cd3eb6d9c6 service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.943502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a414df-4e01-42cf-8805-38b820952ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.944824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a414df-4e01-42cf-8805-38b820952ece service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.945296 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a414df-4e01-42cf-8805-38b820952ece service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.945772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a414df-4e01-42cf-8805-38b820952ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.961964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a414df-4e01-42cf-8805-38b820952ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.965981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a414df-4e01-42cf-8805-38b820952ece service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.981860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1148/2341] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:01.974377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:01.975030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:01.975030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:02.018081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] MFA Rules not processed for user `b5fca77cf7b34fa89bb37048cc44eb86`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:02.019327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:02.052631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1194/2342] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:02.406440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa386-7a0b-4f39-93b6-50b8126ff9fb None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:02.406973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa386-7a0b-4f39-93b6-50b8126ff9fb None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:02.406973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fa386-7a0b-4f39-93b6-50b8126ff9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:02.453926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a29fa386-7a0b-4f39-93b6-50b8126ff9fb None None] MFA Rules not processed for user `c9f8a2db2828478287d356552f3cec10`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:02.455216 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a29fa386-7a0b-4f39-93b6-50b8126ff9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:02.474566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1149/2343] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:06.853735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:06.859259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:06.930915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74fee1-1bd5-488d-8702-5c4769fa24e8 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:06.936267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:06.937161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:06.937446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:06.937728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] PATH_INFO: `/v3/users/6ea568dee76d43aa8a94d55229dc8987` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:06.938953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea568dee76d43aa8a94d55229dc8987)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:06.941657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:06.994926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea568dee76d43aa8a94d55229dc8987'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.003221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea568dee76d43aa8a94d55229dc8987'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.011771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea568dee76d43aa8a94d55229dc8987'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.012615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea568dee76d43aa8a94d55229dc8987'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.013302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea568dee76d43aa8a94d55229dc8987'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.026036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:07.034940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1195/2344] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:06 2022] DELETE /identity/v3/users/6ea568dee76d43aa8a94d55229dc8987 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:07.039912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.041059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.041362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.075833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.078060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.146300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1150/2345] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:07.156631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.159045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.270243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf59dc-43a1-45da-bcf0-8abb484bc438 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.274089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd0fa6-0cc3-48d8-aca8-48aef3b4d440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.274737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd0fa6-0cc3-48d8-aca8-48aef3b4d440 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.275026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd0fa6-0cc3-48d8-aca8-48aef3b4d440 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.275292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd0fa6-0cc3-48d8-aca8-48aef3b4d440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.285417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd0fa6-0cc3-48d8-aca8-48aef3b4d440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.286850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd0fa6-0cc3-48d8-aca8-48aef3b4d440 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.296961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1196/2346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:07.578008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.579439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.602775 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d7d3-99bc-4a87-82be-ded3c8201caf None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.608195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.609073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.609363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.609649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] PATH_INFO: `/v3/projects/ee674fcc546245e3b2299ceeed418b7d` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.610856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee674fcc546245e3b2299ceeed418b7d)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.613089 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.625231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:07.665199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee674fcc546245e3b2299ceeed418b7d', 'request_id': 'req-70701998-abff-4564-9a15-99f4565a203a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.670965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee674fcc546245e3b2299ceeed418b7d', 'request_id': 'req-70701998-abff-4564-9a15-99f4565a203a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.677505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee674fcc546245e3b2299ceeed418b7d', 'request_id': 'req-70701998-abff-4564-9a15-99f4565a203a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.694108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] The token cache is being invalidate because project ee674fcc546245e3b2299ceeed418b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:07.694375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.695050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-70701998-abff-4564-9a15-99f4565a203a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.697231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1151/2347] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:07 2022] DELETE /identity/v3/projects/ee674fcc546245e3b2299ceeed418b7d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:07.702690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.703140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.703456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.746334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.747593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.818654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1197/2348] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:07.827538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.827858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.828162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.849849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.851254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.864503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1152/2349] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:07.866060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.876276 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e08ec-2dac-4e08-9852-9fb38b82bed4 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.882010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.882663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.882951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.883235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.884028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:07.884341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.886036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.898622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1198/2350] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:30:07.903121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.913001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0b399-9c81-4a63-a170-cc3ad5dd3244 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.917834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.918563 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.918852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.919133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.919832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.921872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.952493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1153/2351] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:07.956914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.967337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a2ce3-31bb-4715-b8f0-eb51decfda42 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.001895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.030065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.030744 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.031036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.031321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.032065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.034834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.056326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1199/2352] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:08.063649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.074781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b27b1-e6dc-4810-8638-c712f5b811c2 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.079350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.080041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.080337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.080610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.081345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.082953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.093179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1154/2353] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:08.097953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.108963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19cf2a-087f-4ab4-8336-b0190899bb07 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.114101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05aba-747b-47c6-a116-3ed590b30fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.114763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05aba-747b-47c6-a116-3ed590b30fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.115050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05aba-747b-47c6-a116-3ed590b30fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.115333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05aba-747b-47c6-a116-3ed590b30fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.116098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c05aba-747b-47c6-a116-3ed590b30fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.117704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c05aba-747b-47c6-a116-3ed590b30fe4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.131425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1200/2354] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:08.132788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.143472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322fd16-4514-447e-a13e-44a442fc4c88 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.148259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.149144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.149431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.149714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] PATH_INFO: `/v3/projects/22ff4915276e44d3b28a7745f7e65fe4/users/8922bbae8b244f888611d5e0b9f4cab9/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.164144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ff4915276e44d3b28a7745f7e65fe4, user_id=8922bbae8b244f888611d5e0b9f4cab9, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.166820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.181393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1155/2355] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:08 2022] PUT /identity/v3/projects/22ff4915276e44d3b28a7745f7e65fe4/users/8922bbae8b244f888611d5e0b9f4cab9/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:08.192797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.193092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.193379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.221936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] MFA Rules not processed for user `8922bbae8b244f888611d5e0b9f4cab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:08.223117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.293573 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1201/2356] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:08.305067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.306958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.374505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e13b1-84d5-4425-b697-2821e091e999 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.378311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fd64b-fec4-4b8d-8f60-dd38d138fc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.378961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd64b-fec4-4b8d-8f60-dd38d138fc6d service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.379245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd64b-fec4-4b8d-8f60-dd38d138fc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.379523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd64b-fec4-4b8d-8f60-dd38d138fc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.387865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd64b-fec4-4b8d-8f60-dd38d138fc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.389345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd64b-fec4-4b8d-8f60-dd38d138fc6d service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.400046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1156/2357] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:08.425154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.489340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed1705-d25e-42fc-9910-1d412bd6e564 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.494221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.495129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.495415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.495693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] PATH_INFO: `/v3/users/8922bbae8b244f888611d5e0b9f4cab9` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.497016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8922bbae8b244f888611d5e0b9f4cab9)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.498939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.545001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.546671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8922bbae8b244f888611d5e0b9f4cab9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:08.555730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8922bbae8b244f888611d5e0b9f4cab9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:08.563087 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8922bbae8b244f888611d5e0b9f4cab9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:08.563716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8922bbae8b244f888611d5e0b9f4cab9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:08.564359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8922bbae8b244f888611d5e0b9f4cab9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:08.582690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1202/2358] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:08 2022] DELETE /identity/v3/users/8922bbae8b244f888611d5e0b9f4cab9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:08.587714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.588044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.588330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.606080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:08.607270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.645593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.676466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1157/2359] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:08.686001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.687400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.749113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a2440-fb77-4052-97ed-51df9c37ffa4 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.753462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68461946-1986-487d-b6f0-252e2e96de20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.754116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68461946-1986-487d-b6f0-252e2e96de20 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.754404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68461946-1986-487d-b6f0-252e2e96de20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.754688 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68461946-1986-487d-b6f0-252e2e96de20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.764251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68461946-1986-487d-b6f0-252e2e96de20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.765684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68461946-1986-487d-b6f0-252e2e96de20 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.776547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1203/2360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:09.128136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.129614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:09.142931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec537-1e19-4b29-908d-16f7881faffa None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.149177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.150495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.150788 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.151079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] PATH_INFO: `/v3/projects/22ff4915276e44d3b28a7745f7e65fe4` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.152924 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ff4915276e44d3b28a7745f7e65fe4)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.154937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.206756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ff4915276e44d3b28a7745f7e65fe4', 'request_id': 'req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.212268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ff4915276e44d3b28a7745f7e65fe4', 'request_id': 'req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.218475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ff4915276e44d3b28a7745f7e65fe4', 'request_id': 'req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.233910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] The token cache is being invalidate because project 22ff4915276e44d3b28a7745f7e65fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:09.234215 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.234874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c115d0ba-a3ab-4b7c-83be-a80fe2b7685c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.236591 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1158/2361] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:09 2022] DELETE /identity/v3/projects/22ff4915276e44d3b28a7745f7e65fe4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:09.241851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.242324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.242453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.259969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:09.261134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:09.321948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1204/2362] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:09.329789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.330120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.330437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.349157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:09.350570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:09.359392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1159/2363] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:09.364401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.374418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ec2-e9b9-4a14-9a22-bd75c84458be None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.378977 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.379969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.380259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.380608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.381335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:09.381644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.383620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.397480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1205/2364] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:30:09.402431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.413471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ef976-cf2d-46a6-9bef-e5a6f7041845 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.418176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.418829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.419115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.419408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.420134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.422027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.452145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1160/2365] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:09 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:09.457026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.467140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b9f4-b2ba-4a60-87e5-a6ca4873b12b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.521173 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:09.532397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.533144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.534341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.534991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.535529 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.537600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.559754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1206/2366] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:09 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:09.563843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.574368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f52a-984f-4acc-b73c-94e64f903f36 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.579750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.581174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.581477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.581801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.582572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.584257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.597037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1161/2367] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:09.601543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.612664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54669-e5b3-484f-878a-ae80a4fb3c12 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.617335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807953bf-27e1-41d8-89af-03eab2f03995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.617987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807953bf-27e1-41d8-89af-03eab2f03995 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.618275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807953bf-27e1-41d8-89af-03eab2f03995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.618556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807953bf-27e1-41d8-89af-03eab2f03995 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.619286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807953bf-27e1-41d8-89af-03eab2f03995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.620939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807953bf-27e1-41d8-89af-03eab2f03995 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.633409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1207/2368] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:09.636890 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.647780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2bbc3-83f5-4697-9a2a-ec76b209d911 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.652531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.653413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.653705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.653990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] PATH_INFO: `/v3/projects/e6496e650cfe4770a681cfeb48f9ecec/users/c6b4c8555d5b4d048e6a378c4fb7a8d9/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.669658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6496e650cfe4770a681cfeb48f9ecec, user_id=c6b4c8555d5b4d048e6a378c4fb7a8d9, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.672793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.687040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1162/2369] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:09 2022] PUT /identity/v3/projects/e6496e650cfe4770a681cfeb48f9ecec/users/c6b4c8555d5b4d048e6a378c4fb7a8d9/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:09.693341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd45b-a05f-41e9-ad5f-d268980c9078 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.693657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd45b-a05f-41e9-ad5f-d268980c9078 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.693921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd45b-a05f-41e9-ad5f-d268980c9078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.711863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c5dfd45b-a05f-41e9-ad5f-d268980c9078 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:09.713094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5dfd45b-a05f-41e9-ad5f-d268980c9078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:09.779297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1208/2370] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:09.786424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.788166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:09.849033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7bf82-0014-4b48-a192-be800a8ad1f9 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.852743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.853389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.853678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.853958 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.867160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.867160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.877714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1163/2371] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:14.212399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.213282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.213792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.253419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] MFA Rules not processed for user `c6b4c8555d5b4d048e6a378c4fb7a8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:14.254682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:14.372588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1209/2372] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:14.378255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.383508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:14.388993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd133a-4dc7-41c1-9c9f-88517052f658 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.397515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.398189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.398475 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.398774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.399633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.402107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.431576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1164/2373] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:14 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:14.435476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.450045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0b213-20ae-41cf-b0ac-03c42eda596d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.514382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.515258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.515585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.515939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.516740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.519497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.528991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:14.543164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1210/2374] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:14 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:14.547226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.558269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ee9e-d47e-4afa-9a8d-7120d7275f82 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.563352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.564383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.565574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.565907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.567063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.569197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.582268 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1165/2375] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:14.586959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.597693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a0e9-bc65-47ff-8ef2-519335b367f0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.602951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.604347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.604700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.604989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] PATH_INFO: `/v3/projects/da94ca64762b4c0eabe16647248417b4/users/7a9ef9f663224676ac310329df25ab15/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.625228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da94ca64762b4c0eabe16647248417b4, user_id=7a9ef9f663224676ac310329df25ab15, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.636480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.653220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1211/2376] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:14 2022] PUT /identity/v3/projects/da94ca64762b4c0eabe16647248417b4/users/7a9ef9f663224676ac310329df25ab15/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:14.657313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.669614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffeca7-adf7-4153-9ce6-b8833082b254 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.747055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab5a03-e77a-4623-8c07-e125fe151012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.747751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5a03-e77a-4623-8c07-e125fe151012 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.748164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5a03-e77a-4623-8c07-e125fe151012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.748383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5a03-e77a-4623-8c07-e125fe151012 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.749130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab5a03-e77a-4623-8c07-e125fe151012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.750816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab5a03-e77a-4623-8c07-e125fe151012 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.765855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1166/2377] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:14.770071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.782300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb852c-f404-46e6-ae4d-759107e41e02 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.791314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.792648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.792944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.793515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] PATH_INFO: `/v3/projects/da94ca64762b4c0eabe16647248417b4/users/7a9ef9f663224676ac310329df25ab15/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.795584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da94ca64762b4c0eabe16647248417b4, user_id=7a9ef9f663224676ac310329df25ab15, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.798398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.810925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1212/2378] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:14 2022] PUT /identity/v3/projects/da94ca64762b4c0eabe16647248417b4/users/7a9ef9f663224676ac310329df25ab15/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:20.353763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df000ab-6205-4698-8fec-dc1cea6d0b73 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.354255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df000ab-6205-4698-8fec-dc1cea6d0b73 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.354360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df000ab-6205-4698-8fec-dc1cea6d0b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.416188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4df000ab-6205-4698-8fec-dc1cea6d0b73 None None] MFA Rules not processed for user `7a9ef9f663224676ac310329df25ab15`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:20.417735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4df000ab-6205-4698-8fec-dc1cea6d0b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:20.508326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1167/2379] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:20.522846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.524697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:20.619082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2db1d-7bf1-4ef6-b034-dfdc5246545e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:20.628103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:20.633242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.633485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.633755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.758067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:20.760028 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:20.777608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1213/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:20.966717 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772568d2-44b6-4fe5-9a0d-6518f3ab54e0 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.967275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772568d2-44b6-4fe5-9a0d-6518f3ab54e0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.967789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772568d2-44b6-4fe5-9a0d-6518f3ab54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.005987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-772568d2-44b6-4fe5-9a0d-6518f3ab54e0 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:21.007256 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-772568d2-44b6-4fe5-9a0d-6518f3ab54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.059111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:21.077541 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1168/2381] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:21.129767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:21.131818 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.205884 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2933455-4bca-4483-b03c-b48c32c2456f service glance] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.210902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bd9a1-fd5a-4e76-b98a-a3e8c59c1288 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.211550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bd9a1-fd5a-4e76-b98a-a3e8c59c1288 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.211841 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bd9a1-fd5a-4e76-b98a-a3e8c59c1288 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.212160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bd9a1-fd5a-4e76-b98a-a3e8c59c1288 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.220184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bd9a1-fd5a-4e76-b98a-a3e8c59c1288 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.222880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bd9a1-fd5a-4e76-b98a-a3e8c59c1288 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:21.226619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:21.234256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1214/2382] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:30:31.070463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=6 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:31.235763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:33.218149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d469bf-3d39-445c-ab7e-df4582c05785 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.219395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d469bf-3d39-445c-ab7e-df4582c05785 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.219575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d469bf-3d39-445c-ab7e-df4582c05785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.239311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b9d469bf-3d39-445c-ab7e-df4582c05785 None None] MFA Rules not processed for user `c6b4c8555d5b4d048e6a378c4fb7a8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:33.240624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b9d469bf-3d39-445c-ab7e-df4582c05785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.247896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1169/2383] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:35.069013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:35.069649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:35.070681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:35.109201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] MFA Rules not processed for user `8e388fb4942847e1b671e6e6da0a72b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:35.110686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:35.206851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1215/2384] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:30:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:40.637612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:40.638614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:40.639154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:40.661460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:40.663253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:40.682597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1170/2385] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:30:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:40.703355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:40.718813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce23e9-0eff-4daf-b76a-4539ea51a526 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:40.729509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbe6a9-74bf-40dc-a9b0-3e5ebc981176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:40.730688 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbe6a9-74bf-40dc-a9b0-3e5ebc981176 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:40.731185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbe6a9-74bf-40dc-a9b0-3e5ebc981176 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:40.732618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbe6a9-74bf-40dc-a9b0-3e5ebc981176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:40.745133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbe6a9-74bf-40dc-a9b0-3e5ebc981176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:40.748042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbe6a9-74bf-40dc-a9b0-3e5ebc981176 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:40.770970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1216/2386] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:30:50.674186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=9 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:50.758879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=31 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:00.909504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.971586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848353b-f126-4f94-b81f-24a9f1622f5c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.975826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.976561 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.976854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.977138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.978963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:01.054433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:01.055908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:01.066375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1171/2387] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:05.890633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10602-4167-4633-96dc-968f9e5190ea None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:05.891248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10602-4167-4633-96dc-968f9e5190ea None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:05.891248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10602-4167-4633-96dc-968f9e5190ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:05.929716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b6c10602-4167-4633-96dc-968f9e5190ea None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:05.930939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b6c10602-4167-4633-96dc-968f9e5190ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:05.998562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1217/2388] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:06.022487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:06.024093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:06.163967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a5348-e111-45e5-86a3-73c967c46a11 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:06.169496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:06.170160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:06.170432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:06.170841 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:06.179766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:06.181427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:06.193003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1172/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:11.834807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521eee-6f28-42cb-8ab4-81df392cb545 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.835322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521eee-6f28-42cb-8ab4-81df392cb545 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.835420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521eee-6f28-42cb-8ab4-81df392cb545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.894905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4b521eee-6f28-42cb-8ab4-81df392cb545 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:11.896142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4b521eee-6f28-42cb-8ab4-81df392cb545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:11.916855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1218/2390] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:11.929201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.951762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eebdc7-49a6-4fa6-bdc8-014f3fd860d9 service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.958091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.958740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.959023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.959303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.964267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:11.968806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.971534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.979602 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1173/2391] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:31:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:31:13.067784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631bf0-abb7-40af-a8c6-07e7141d0812 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:13.068868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631bf0-abb7-40af-a8c6-07e7141d0812 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:13.069337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631bf0-abb7-40af-a8c6-07e7141d0812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:13.095006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-42631bf0-abb7-40af-a8c6-07e7141d0812 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:13.096515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-42631bf0-abb7-40af-a8c6-07e7141d0812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:13.107313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1219/2392] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:13.137849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:13.154835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:13.174029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a71bd-fb07-404e-83a1-61b9ee9caf83 service swift] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:13.181413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:13.182441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:13.182734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:13.183024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:13.194142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:13.196158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:13.208768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1174/2393] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:19.580133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:19.586362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:19.588454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:19.680855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:19.682340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:19.709262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1220/2394] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:19.743279 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:19.758576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86cbed-7dc7-4a22-813c-13acca83d6cf service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:19.765574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb9a0-a4c6-4310-b7f8-8ad0f3d6e0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:19.766468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb9a0-a4c6-4310-b7f8-8ad0f3d6e0ee service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:19.767260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb9a0-a4c6-4310-b7f8-8ad0f3d6e0ee service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:19.767755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb9a0-a4c6-4310-b7f8-8ad0f3d6e0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:19.780450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abeb9a0-a4c6-4310-b7f8-8ad0f3d6e0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:19.784058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abeb9a0-a4c6-4310-b7f8-8ad0f3d6e0ee service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:19.800164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1175/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:21.614287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:21.627232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275b741-1389-4714-b453-664b8ddc5598 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:21.632182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:21.632850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:21.633220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:21.633662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:21.647658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:21.649354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:21.661631 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1221/2396] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:23.745587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:23.746093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:23.746276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:23.784905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:23.786593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:23.801982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1176/2397] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:23.823843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:23.856134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34940ca-e6cf-4470-94a3-99784c0d865c service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:23.867472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b42447-2f7a-46d4-b4b4-17340c45e6a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:23.868668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b42447-2f7a-46d4-b4b4-17340c45e6a7 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:23.868960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b42447-2f7a-46d4-b4b4-17340c45e6a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:23.869353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b42447-2f7a-46d4-b4b4-17340c45e6a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:23.880170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b42447-2f7a-46d4-b4b4-17340c45e6a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:23.881822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b42447-2f7a-46d4-b4b4-17340c45e6a7 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:23.893210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1222/2398] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:29.259816 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:29.261937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:29.365421 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4be6-1eea-44d4-b0f6-cea872685b7d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:29.370508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:29.371201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:29.371492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:29.371771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:29.373566 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:29.385709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:29.387303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:29.397661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1177/2399] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:29.997141 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1108e4-efdf-4bcd-ab52-b3e9f6d964ef None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:29.997647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1108e4-efdf-4bcd-ab52-b3e9f6d964ef None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:29.997753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1108e4-efdf-4bcd-ab52-b3e9f6d964ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:30.017096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-0a1108e4-efdf-4bcd-ab52-b3e9f6d964ef None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:30.018284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0a1108e4-efdf-4bcd-ab52-b3e9f6d964ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:30.025953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1223/2400] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:30.051607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:30.065203 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa8e16-7169-4dc8-95c5-ddba9414ea72 service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:30.070864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321533f-934e-4b72-b98f-df6f2185f64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:30.071549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321533f-934e-4b72-b98f-df6f2185f64f service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:30.071935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321533f-934e-4b72-b98f-df6f2185f64f service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:30.072225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321533f-934e-4b72-b98f-df6f2185f64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:30.082255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321533f-934e-4b72-b98f-df6f2185f64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:30.084240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321533f-934e-4b72-b98f-df6f2185f64f service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:30.096251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1178/2401] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:31.245388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ea99a-612c-4d3c-8d8d-3897a0f336f8 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.245951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ea99a-612c-4d3c-8d8d-3897a0f336f8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.246242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ea99a-612c-4d3c-8d8d-3897a0f336f8 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.247748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1224/2402] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:31.255486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208949e-afac-4bdb-a5de-f96cee301203 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.256025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208949e-afac-4bdb-a5de-f96cee301203 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.256330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208949e-afac-4bdb-a5de-f96cee301203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.294196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0208949e-afac-4bdb-a5de-f96cee301203 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:31.295414 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0208949e-afac-4bdb-a5de-f96cee301203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:31.305243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1179/2403] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:31:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:31.317444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ea99a-612c-4d3c-8d8d-3897a0f336f8 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:31.323077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=71 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:31.340233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ea99a-612c-4d3c-8d8d-3897a0f336f8 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:31.343849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd83bd-645f-4381-a5af-2b2d50fd9877 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b964670153a46e7b5d41c5fae889860', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:31.345150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd83bd-645f-4381-a5af-2b2d50fd9877 service glance] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.345676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd83bd-645f-4381-a5af-2b2d50fd9877 service glance] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.345987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd83bd-645f-4381-a5af-2b2d50fd9877 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.356739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd83bd-645f-4381-a5af-2b2d50fd9877 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:31.358178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd83bd-645f-4381-a5af-2b2d50fd9877 service glance] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:31.369742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1225/2404] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:31.440125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6b466-8b10-425b-9c41-c076a5665a4a None None] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.440422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6b466-8b10-425b-9c41-c076a5665a4a None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.440709 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6b466-8b10-425b-9c41-c076a5665a4a None None] PATH_INFO: `/` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.442101 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1180/2405] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:31.447195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0c69-e403-47cc-afb5-7a0cb26b49ba None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.447490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0c69-e403-47cc-afb5-7a0cb26b49ba None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.447772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0c69-e403-47cc-afb5-7a0cb26b49ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.466801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-849c0c69-e403-47cc-afb5-7a0cb26b49ba None None] MFA Rules not processed for user `cb15a3e003fb4f0f8f876c5635b6a020`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:31.467964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-849c0c69-e403-47cc-afb5-7a0cb26b49ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:31.475593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1226/2406] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:31:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:31.487795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6b466-8b10-425b-9c41-c076a5665a4a None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:31.498857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6b466-8b10-425b-9c41-c076a5665a4a None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:31.503051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caceb1e-e4c9-4951-90e2-24f1425c6121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:31.503685 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caceb1e-e4c9-4951-90e2-24f1425c6121 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.504009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caceb1e-e4c9-4951-90e2-24f1425c6121 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.504297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caceb1e-e4c9-4951-90e2-24f1425c6121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.511487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caceb1e-e4c9-4951-90e2-24f1425c6121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:31.512953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caceb1e-e4c9-4951-90e2-24f1425c6121 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:31.521416 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1181/2407] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:31.603695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52251a-6a50-490b-acb9-06fbb463fca2 None None] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.604030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52251a-6a50-490b-acb9-06fbb463fca2 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.604317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52251a-6a50-490b-acb9-06fbb463fca2 None None] PATH_INFO: `/` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.605960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1227/2408] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 16 00:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:31.611825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061469f-8261-40b8-a119-a25e9192d080 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.612149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061469f-8261-40b8-a119-a25e9192d080 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.612420 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061469f-8261-40b8-a119-a25e9192d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.630826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-f061469f-8261-40b8-a119-a25e9192d080 None None] MFA Rules not processed for user `450a31adc83e4bf0a8b21c86806981a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:31.632059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f061469f-8261-40b8-a119-a25e9192d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:31.641959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1182/2409] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 16 00:31:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:31.652158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52251a-6a50-490b-acb9-06fbb463fca2 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:31.663113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52251a-6a50-490b-acb9-06fbb463fca2 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:31.666720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:31.667357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:31.667643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:31.667955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:31.678231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:31.679658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:31.690960 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1228/2410] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:34.188800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a12d-3b7a-42e1-96e3-91b3003e026c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:34.188800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a12d-3b7a-42e1-96e3-91b3003e026c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:34.189800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a12d-3b7a-42e1-96e3-91b3003e026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:34.207785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2b78a12d-3b7a-42e1-96e3-91b3003e026c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:34.209001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2b78a12d-3b7a-42e1-96e3-91b3003e026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:34.217410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1183/2411] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:34.261962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:34.273594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd5fa2-1f58-4060-890a-c609643a3655 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:34.279169 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:34.279810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:34.280152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:34.280436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:34.289519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:34.291166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:34.301852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1229/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:37.770801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293d982-c247-456c-9b81-0bbd1bcae7ac None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:37.771269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293d982-c247-456c-9b81-0bbd1bcae7ac None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:37.771373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293d982-c247-456c-9b81-0bbd1bcae7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:37.788765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d293d982-c247-456c-9b81-0bbd1bcae7ac None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:37.789960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d293d982-c247-456c-9b81-0bbd1bcae7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:37.797023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1184/2413] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:31:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:37.808671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:37.824129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283bb7-ea1d-4fbe-bbb0-0b4bf3a9e4d9 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:37.830368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:37.831114 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:37.831421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:37.831703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:37.839951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:37.841535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:37.850142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1230/2414] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:31:47.783726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:47.847117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=30 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:08.496370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d520de-d05b-496c-b005-f45d96e0bd59 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:08.496899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d520de-d05b-496c-b005-f45d96e0bd59 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:08.497000 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d520de-d05b-496c-b005-f45d96e0bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:08.516440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-b7d520de-d05b-496c-b005-f45d96e0bd59 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:08.517658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b7d520de-d05b-496c-b005-f45d96e0bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:08.525222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1185/2415] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 00:32:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:08.538095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:08.549503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0603c93-1366-4007-83db-991c8f6772a5 service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:08.555130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68c010-00c4-4407-b2df-ef789636b544 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:08.555865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68c010-00c4-4407-b2df-ef789636b544 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:08.556256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68c010-00c4-4407-b2df-ef789636b544 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:08.556638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68c010-00c4-4407-b2df-ef789636b544 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:08.566356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68c010-00c4-4407-b2df-ef789636b544 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:08.568119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68c010-00c4-4407-b2df-ef789636b544 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:08.576799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1231/2416] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:32:12.836143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.836619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.836733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.856594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] MFA Rules not processed for user `c9f8a2db2828478287d356552f3cec10`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:12.858654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:12.915092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1186/2417] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:18.573525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=6 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:22.908468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=28 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:26.893314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13486c05-12e3-4bac-88c0-8ffc854c098f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:26.893848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13486c05-12e3-4bac-88c0-8ffc854c098f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:26.893848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13486c05-12e3-4bac-88c0-8ffc854c098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:26.911904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-13486c05-12e3-4bac-88c0-8ffc854c098f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:26.913083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-13486c05-12e3-4bac-88c0-8ffc854c098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:26.920857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1232/2418] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:26.941950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:26.957702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e196-44d2-491c-8654-dbfd42b82f62 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:26.963035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:26.963673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:26.963997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:26.964281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:26.973341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:26.974914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:26.984700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1187/2419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:31.178393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cf3f-ed3e-4289-8e3c-3d3fac9fa132 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.178939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cf3f-ed3e-4289-8e3c-3d3fac9fa132 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.178939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cf3f-ed3e-4289-8e3c-3d3fac9fa132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.196303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3d49cf3f-ed3e-4289-8e3c-3d3fac9fa132 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:31.197478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3d49cf3f-ed3e-4289-8e3c-3d3fac9fa132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:31.206479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1233/2420] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:31.227686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:31.239644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a5ad-79f0-43aa-918c-f282f21075c2 service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:31.245282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:31.245943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:31.246233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:31.246514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:31.254621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:31.256222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:31.266172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1188/2421] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:35.265613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6011-e15d-4491-9a56-76ae3282efab None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:35.266099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6011-e15d-4491-9a56-76ae3282efab None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:35.266099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d6011-e15d-4491-9a56-76ae3282efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:35.283766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a60d6011-e15d-4491-9a56-76ae3282efab None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:35.284995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a60d6011-e15d-4491-9a56-76ae3282efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:35.292869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1234/2422] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:35.320251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:35.332202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877a03-adc7-4f06-a475-27026239d550 service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:35.337702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:35.338335 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:35.338655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:35.338941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:35.347254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:35.348862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:35.358519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1189/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:39.478360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.478908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.478908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.497934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:39.500039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:39.508414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1235/2424] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:39.529209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:39.541225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49add951-c5c8-48c8-aac6-42702e203d8f service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:39.547331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790c0d-f2b3-4bcf-9667-df68accfdfd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:39.548014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790c0d-f2b3-4bcf-9667-df68accfdfd0 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:39.548309 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790c0d-f2b3-4bcf-9667-df68accfdfd0 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:39.548593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790c0d-f2b3-4bcf-9667-df68accfdfd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:39.557240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790c0d-f2b3-4bcf-9667-df68accfdfd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:39.558834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790c0d-f2b3-4bcf-9667-df68accfdfd0 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:39.569526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1190/2425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:40.934279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:40.935669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:40.948089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a39f-b527-4c39-8c14-f870dac0a243 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:40.951624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:40.952332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:40.952706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:40.952993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:40.954704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:40.967625 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:40.969112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:40.980215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1236/2426] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:43.634159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:43.634669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:43.634768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:43.652403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:43.653592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:43.661948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1191/2427] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:43.696442 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:43.708004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16282-b2a2-4b58-a04e-d15f9713a4ad service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:43.714253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:43.714893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:43.715263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:43.715650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:43.724503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:43.726105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:43.737115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1237/2428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:45.595753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:45.605439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b0e5d-425a-4086-84b7-d6bb53b8217d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:45.609359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:45.610051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:45.610293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:45.610603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:45.612481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:45.625908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:45.627351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:45.638180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1192/2429] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:53.731632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=24 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:55.633373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=33 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:16.069263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:16.070821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:16.085812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb0ed0-0306-4f68-ad25-611c5f647776 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:16.091086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:16.091763 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:16.092105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:16.092393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:16.094179 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:16.108990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:16.110786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:16.126824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:16.128368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:16.129453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1238/2430] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:16.146946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1a746-6d01-4388-a0ac-fd187aae09b1 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:16.153074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:16.155055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:16.155552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:16.156241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] PATH_INFO: `/v3/users/c9f8a2db2828478287d356552f3cec10` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:16.157395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f8a2db2828478287d356552f3cec10)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:16.160342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:16.212236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f8a2db2828478287d356552f3cec10'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.220043 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f8a2db2828478287d356552f3cec10'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.228225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f8a2db2828478287d356552f3cec10'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.228894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f8a2db2828478287d356552f3cec10'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.229513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f8a2db2828478287d356552f3cec10'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.249248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1193/2431] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:33:16 2022] DELETE /identity/v3/users/c9f8a2db2828478287d356552f3cec10 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:16.410742 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:16.426007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b648b0-a16e-4970-bede-2b4044540cdb service placement] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:16.430042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:16.432429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:16.507490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:16.508177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:16.508462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:16.508740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:16.510530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:16.513034 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09019-1c39-426f-8ac1-bd563e3ce1c6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:16.517827 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:16.518683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:16.519109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:16.519109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] PATH_INFO: `/v3/projects/adbb0bdf448f45b28f63131ad9876016` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:16.520795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbb0bdf448f45b28f63131ad9876016)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:16.523083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:16.572018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:16.572242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbb0bdf448f45b28f63131ad9876016', 'request_id': 'req-73fa33c1-9433-429a-9c26-908ca0f935f6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.573629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:16.577651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbb0bdf448f45b28f63131ad9876016', 'request_id': 'req-73fa33c1-9433-429a-9c26-908ca0f935f6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.583689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1239/2432] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:16.588076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbb0bdf448f45b28f63131ad9876016', 'request_id': 'req-73fa33c1-9433-429a-9c26-908ca0f935f6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.602805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] The token cache is being invalidate because project adbb0bdf448f45b28f63131ad9876016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:33:16.603107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.603752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:16.605334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1194/2433] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:33:16 2022] DELETE /identity/v3/projects/adbb0bdf448f45b28f63131ad9876016 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:21.342247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:21.344185 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:21.365032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a92e-5176-4ead-8ff6-8a7e50d6d4e1 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:21.442112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:21.442919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:21.443215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:21.443500 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:21.445417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:21.459220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:21.464157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b295a6-f781-4cf1-904d-872aaa274ba4 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:21.477017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1240/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:24.641014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:24.642297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:24.647785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:24.711794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa33c1-9433-429a-9c26-908ca0f935f6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:24.715596 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:24.716292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:24.716584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:24.716867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:24.718785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:24.728912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:24.730373 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:24.739061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1195/2435] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:25.202254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:25.202780 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:25.202909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:25.220159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] MFA Rules not processed for user `23f4bd4c685d489dbcec17b69656044e`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:25.221360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:25.225804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:25.280283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1241/2436] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:33:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:25.571487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:25.580366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acab565-5765-4d68-9fab-283b9e88e273 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:25.584761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:25.585418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:25.585690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:25.585972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:25.587754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:25.597150 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:25.598985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea0a6d-cf92-4144-a24f-926c283039ef service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:25.608069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1196/2437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:25.992994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:25.994549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:26.066873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6295-9f11-40eb-892b-774c97a07b33 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:26.072354 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:26.072996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.073279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.073555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.075323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:26.086422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:26.088037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:26.097703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1242/2438] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:27.070888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:27.071429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:27.071537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:27.089785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] MFA Rules not processed for user `8e388fb4942847e1b671e6e6da0a72b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:27.091051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:27.149418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1197/2439] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:33:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:32.609710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:32.611698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:32.627956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8616841-f48f-41c8-aa86-c5bc30b92468 service placement] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:32.634170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:32.634830 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:32.635119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:32.635395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:32.637210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:32.651547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:32.652797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:32.664517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1243/2440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:37.142224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=56 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:39.088767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:39.090797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:39.110569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fcfa-51d7-46ef-b719-629623aa5e0e None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:39.117063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:39.117750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:39.118072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:39.118359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:39.120259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:39.132853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:39.134448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49426d-3b06-41bf-b05d-034be15f7414 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:39.145521 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1198/2441] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:42.659588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=59 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:49.140705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=6 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:57.012799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:57.014317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:57.098425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b21b9-9ff8-45b3-9877-0d720c0b58c3 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:57.102751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:57.103403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:57.103691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:57.104009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:57.105823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:57.167054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:57.168541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa84e2-2c71-4866-9abc-f8c02c6ff427 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:57.177562 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1244/2442] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:02.983327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:02.983898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:02.984200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:03.002853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] MFA Rules not processed for user `4d811ae109464ec983d1902839be090a`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:03.004128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:03.012014 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1199/2443] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:34:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:07.173401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=57 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:12.997489 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:26.483915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:26.484382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:26.484481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:26.502158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:26.503336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:26.557533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1245/2444] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 00:34:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:26.611276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:26.612820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:26.699223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7428f-bd3a-41fa-8f9a-7dc2755c81bf None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:26.704151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:26.704797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:26.705083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:26.705363 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:26.713616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:26.715196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:26.723035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1200/2445] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:33.590011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:33.591580 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:33.659835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e078e-659b-4ae5-910c-27d229e91b8d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:33.664417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:33.665273 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:33.665555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:33.665832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] PATH_INFO: `/v3/users/c6b4c8555d5b4d048e6a378c4fb7a8d9` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:33.667054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b4c8555d5b4d048e6a378c4fb7a8d9)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:33.669009 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:33.713949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b4c8555d5b4d048e6a378c4fb7a8d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:33.720914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b4c8555d5b4d048e6a378c4fb7a8d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:33.728226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b4c8555d5b4d048e6a378c4fb7a8d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:33.729134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b4c8555d5b4d048e6a378c4fb7a8d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:33.729869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b4c8555d5b4d048e6a378c4fb7a8d9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:33.750741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1246/2446] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:34:33 2022] DELETE /identity/v3/users/c6b4c8555d5b4d048e6a378c4fb7a8d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:33.926654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:33.940249 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678f45-541e-40be-affa-a5617bf8781a service swift] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:33.997783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:33.998618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:33.998911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:33.999190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] PATH_INFO: `/v3/projects/e6496e650cfe4770a681cfeb48f9ecec` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:34.000370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6496e650cfe4770a681cfeb48f9ecec)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:34.002260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:34.048482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6496e650cfe4770a681cfeb48f9ecec', 'request_id': 'req-8348b32f-3422-4774-aa7c-6c17deb998d3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.054179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6496e650cfe4770a681cfeb48f9ecec', 'request_id': 'req-8348b32f-3422-4774-aa7c-6c17deb998d3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.061577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6496e650cfe4770a681cfeb48f9ecec', 'request_id': 'req-8348b32f-3422-4774-aa7c-6c17deb998d3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.075242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] The token cache is being invalidate because project e6496e650cfe4770a681cfeb48f9ecec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:34:34.075531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.076197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.077729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1201/2447] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:34:33 2022] DELETE /identity/v3/projects/e6496e650cfe4770a681cfeb48f9ecec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:34.081794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:34.083229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:34.096561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c35e66-b3c0-479f-a61b-f7fdb1a5f600 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:34.117274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:34.155617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:34.156520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:34.156816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:34.157096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] PATH_INFO: `/v3/users/7a9ef9f663224676ac310329df25ab15` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:34.158296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9ef9f663224676ac310329df25ab15)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:34.160275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:34.206542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9ef9f663224676ac310329df25ab15'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.213516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9ef9f663224676ac310329df25ab15'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.220524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9ef9f663224676ac310329df25ab15'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.221168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9ef9f663224676ac310329df25ab15'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.221784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9ef9f663224676ac310329df25ab15'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.241032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1247/2448] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:34:34 2022] DELETE /identity/v3/users/7a9ef9f663224676ac310329df25ab15 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:34.420919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:34.422470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:34.436232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b32f-3422-4774-aa7c-6c17deb998d3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:34.441340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:34.494919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:34.495802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:34.496118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:34.496398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] PATH_INFO: `/v3/projects/da94ca64762b4c0eabe16647248417b4` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:34.497567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da94ca64762b4c0eabe16647248417b4)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:34.499500 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:34.546061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da94ca64762b4c0eabe16647248417b4', 'request_id': 'req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.551388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da94ca64762b4c0eabe16647248417b4', 'request_id': 'req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.557693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da94ca64762b4c0eabe16647248417b4', 'request_id': 'req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.570445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] The token cache is being invalidate because project da94ca64762b4c0eabe16647248417b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:34:34.571129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.571485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:34.573060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1202/2449] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:34:34 2022] DELETE /identity/v3/projects/da94ca64762b4c0eabe16647248417b4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:38.943653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:38.945251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:39.007793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d28c5-22d8-41e0-a1d6-424e0f74cdaa admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:39.055178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:39.056600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:39.056906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:39.057190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:39.059043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:39.071921 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:39.121415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:39.122856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:39.131796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1248/2450] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:44.566811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:49.127771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=21 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:56.688534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:56.689976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:56.749893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb5a3-c582-48a8-a87e-d8082f82cd25 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:56.753511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:56.754156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:56.754445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:56.754724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:56.756531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:56.823601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:56.825069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:56.835003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1203/2451] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:59.898424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:59.900370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:59.952453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:59.954262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:59.968749 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ca28-d140-4600-bfe8-905c75bf7265 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:59.973639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:59.974858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:59.975149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:59.975452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] PATH_INFO: `/v3/users/8e388fb4942847e1b671e6e6da0a72b6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:59.976941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e388fb4942847e1b671e6e6da0a72b6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:59.978851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0f9c7-6565-4bd7-a57e-6b3f34950f51 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:59.979577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:59.990204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:59.990204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:59.990204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:59.990204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:59.990651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:00.000068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.001685 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.013417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1249/2452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:34:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:35:00.035598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e388fb4942847e1b671e6e6da0a72b6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.045669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e388fb4942847e1b671e6e6da0a72b6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.053312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e388fb4942847e1b671e6e6da0a72b6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.054008 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e388fb4942847e1b671e6e6da0a72b6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.054625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-64fa3c48-a5b2-466c-8861-aef1c0ef3b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e388fb4942847e1b671e6e6da0a72b6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.073381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1204/2453] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:34:59 2022] DELETE /identity/v3/users/8e388fb4942847e1b671e6e6da0a72b6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:35:00.247472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.258499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4d51-0246-4dc3-ac2d-424bc330cbf0 service placement] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.316697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.317547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.317831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.318109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] PATH_INFO: `/v3/projects/fb169552f35d46068965a07c802f9d1c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.319274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb169552f35d46068965a07c802f9d1c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.321198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.366610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb169552f35d46068965a07c802f9d1c', 'request_id': 'req-4180f7c2-9132-496d-91bd-d6430790f14b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.372695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb169552f35d46068965a07c802f9d1c', 'request_id': 'req-4180f7c2-9132-496d-91bd-d6430790f14b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.378918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb169552f35d46068965a07c802f9d1c', 'request_id': 'req-4180f7c2-9132-496d-91bd-d6430790f14b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.390931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] The token cache is being invalidate because project fb169552f35d46068965a07c802f9d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:35:00.391225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.391850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-4180f7c2-9132-496d-91bd-d6430790f14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:35:00.393534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1250/2454] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:35:00 2022] DELETE /identity/v3/projects/fb169552f35d46068965a07c802f9d1c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:35:00.398569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.398868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.399155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.419098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:00.420348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:00.437472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:00.485551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1205/2455] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:00.493212 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.493513 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.494226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.513209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:00.514491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:00.522496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1251/2456] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:00.526920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.537899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d653e4-8924-4be6-bf34-e48a95d7e8d0 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.543528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.544343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.544700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.545053 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.545828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:35:00.546184 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.548358 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.560795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1206/2457] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:35:00.565120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.575266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae4f20-52d5-49af-aa0a-9f654c1f8d52 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.579981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.580629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.580913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.581189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.581885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.583768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.594804 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:00.622086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1252/2458] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:35:00 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:35:00.626314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.637098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2213-5a8d-42fc-a844-7029c6f0735c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.696654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.697892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.698175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.698453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.699147 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.701300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.726753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1207/2459] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:35:00 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:35:00.728382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.739259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077deeb4-48f9-4ea5-a962-83279712029e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.744492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.744900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.745192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.745478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.746327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.748026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.758736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1253/2460] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:35:00.763400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.775040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a202221-d321-47d0-abce-3fe62d77c440 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.782759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59556b68-f954-44e4-988b-dcd8d4527f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.783444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59556b68-f954-44e4-988b-dcd8d4527f5a admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.783974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59556b68-f954-44e4-988b-dcd8d4527f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.784468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59556b68-f954-44e4-988b-dcd8d4527f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.785470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59556b68-f954-44e4-988b-dcd8d4527f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.787084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59556b68-f954-44e4-988b-dcd8d4527f5a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.799499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1208/2461] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:35:00.803627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.814901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1748c31-3d8a-4fbb-ad57-8b9c65922ae5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:00.819538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:00.820446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.820736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.821013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] PATH_INFO: `/v3/projects/ff1ced1dfccb472a81a7502002aab2c2/users/568d5348695e4dfeb57350dbc404ec48/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.846900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1ced1dfccb472a81a7502002aab2c2, user_id=568d5348695e4dfeb57350dbc404ec48, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:00.849952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:00.866822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1254/2462] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:35:00 2022] PUT /identity/v3/projects/ff1ced1dfccb472a81a7502002aab2c2/users/568d5348695e4dfeb57350dbc404ec48/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:35:00.873226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c2ab1-be44-42e9-9413-6503ff39268b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:00.873651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c2ab1-be44-42e9-9413-6503ff39268b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:00.874015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c2ab1-be44-42e9-9413-6503ff39268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:00.897625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-432c2ab1-be44-42e9-9413-6503ff39268b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:00.898849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-432c2ab1-be44-42e9-9413-6503ff39268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:00.970450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1209/2463] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:00.980308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:00.982438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:01.040214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81769a-845f-4b4a-a85c-6bdd607ed6d1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:01.044116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:01.044762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:01.045100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:01.045374 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:01.054874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:01.056986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:01.066619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1255/2464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:35:05.125330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb595-3026-41a7-972d-4c9f55d2acf8 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:05.125857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb595-3026-41a7-972d-4c9f55d2acf8 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:05.125956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb595-3026-41a7-972d-4c9f55d2acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:05.154854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1ddcb595-3026-41a7-972d-4c9f55d2acf8 None None] MFA Rules not processed for user `568d5348695e4dfeb57350dbc404ec48`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:05.155457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1ddcb595-3026-41a7-972d-4c9f55d2acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:05.176276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:05.237331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1210/2465] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:05.251909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:05.253372 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:05.347611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61905-f1c1-4fb0-9a9d-4cf62a09f2da service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:05.356604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:05.357406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:05.357710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:05.357974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:05.368417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:05.370520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:05.381875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1256/2466] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:35:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:35:06.700835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ed35-f92d-4242-b616-ae89d23d5163 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:06.701368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ed35-f92d-4242-b616-ae89d23d5163 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:06.701368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ed35-f92d-4242-b616-ae89d23d5163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:06.719929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6d50ed35-f92d-4242-b616-ae89d23d5163 None None] MFA Rules not processed for user `568d5348695e4dfeb57350dbc404ec48`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:06.721135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6d50ed35-f92d-4242-b616-ae89d23d5163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:06.728213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1211/2467] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:35:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:07.091063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:07.093210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:07.106494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b0b3-21a7-4107-a027-63da3044aa6c service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:07.110803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:07.111630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:07.112166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:07.112619 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:07.114585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:07.125584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:07.127041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:07.138081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1257/2468] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:35:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:35:16.714225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=22 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:17.132517 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:21.207670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ddcc7-8811-4411-962f-a8d9054fde5c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:21.208164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ddcc7-8811-4411-962f-a8d9054fde5c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:21.208258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ddcc7-8811-4411-962f-a8d9054fde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:21.226620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-345ddcc7-8811-4411-962f-a8d9054fde5c None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:21.228441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-345ddcc7-8811-4411-962f-a8d9054fde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:21.285972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1212/2469] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:35:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:21.298942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:21.300395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:21.371587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5377-c482-4fae-ad7b-114b173d01a3 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:21.376704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:21.377355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:21.377646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:21.377928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:21.387570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:21.389425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:21.398990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1258/2470] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:35:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:35:31.279739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=25 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:31.395083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=32 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:39.088418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbceaa2-b643-4a23-be74-d223dc9c9f1e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:39.089408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbceaa2-b643-4a23-be74-d223dc9c9f1e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:39.089517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbceaa2-b643-4a23-be74-d223dc9c9f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:39.110528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-6cbceaa2-b643-4a23-be74-d223dc9c9f1e None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:39.112038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6cbceaa2-b643-4a23-be74-d223dc9c9f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:39.119790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1213/2471] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:39.136296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:39.146857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4a58c-1bed-41b6-8201-7cbdbcb3696f service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:39.152639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:39.153391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:39.153676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:39.153956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:39.162213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:39.163961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:39.173081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1259/2472] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:35:49.103836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:49.169571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=6 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:01.168723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:01.169196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:01.169292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:01.189050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:01.190255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:01.197956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1214/2473] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 00:36:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:01.210277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:01.221042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809d04-ecbf-4162-9964-009fdec20a47 service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:01.226102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:01.226766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:01.227055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:01.227355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:01.236467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:01.238044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:01.246181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1260/2474] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:07.235383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:07.244935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b3a2-afb9-4e0a-9203-ed4c21da3f09 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:07.249817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:07.250225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:07.250515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:07.250793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:07.252628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:07.318046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:07.319538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:07.329631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1215/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:11.243079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=6 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:12.402605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:12.413907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f456ca-689b-4d44-92c6-f2b8329de092 service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:12.417565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:12.418197 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:12.418552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:12.418833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:12.421018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:12.432686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:12.434155 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:12.444218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1261/2476] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:13.488610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:13.497070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f402-fa26-4dee-b1f0-19f4287b7fd4 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:13.502721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:13.503463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:13.503763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:13.504082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:13.505898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:13.518483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:13.519943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:13.529702 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1216/2477] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:17.019352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.021403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:17.041762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f1aa-591c-4011-91a2-2bdb769ae889 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:17.048493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:17.050356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.054643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.055198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] PATH_INFO: `/v3/users/4d811ae109464ec983d1902839be090a` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.056920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d811ae109464ec983d1902839be090a)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:17.059097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:17.131430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d811ae109464ec983d1902839be090a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.142540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d811ae109464ec983d1902839be090a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.153578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d811ae109464ec983d1902839be090a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.154454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d811ae109464ec983d1902839be090a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.156277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c03d4a8b-ad11-46b6-bf97-cfaf670ae1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d811ae109464ec983d1902839be090a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.191387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1262/2478] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:17 2022] DELETE /identity/v3/users/4d811ae109464ec983d1902839be090a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:17.381843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.394242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e78c4-6ee8-4d3d-ab5d-cf1e78022ed5 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:17.470817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:17.472178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.472629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.473094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] PATH_INFO: `/v3/projects/fd0c87091ca240cea6fb09bf8c6c60ef` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.474783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0c87091ca240cea6fb09bf8c6c60ef)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:17.477254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:17.544461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0c87091ca240cea6fb09bf8c6c60ef', 'request_id': 'req-83f51e04-28fb-4d62-8b82-ae5f097ffac0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.551955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0c87091ca240cea6fb09bf8c6c60ef', 'request_id': 'req-83f51e04-28fb-4d62-8b82-ae5f097ffac0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.558331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0c87091ca240cea6fb09bf8c6c60ef', 'request_id': 'req-83f51e04-28fb-4d62-8b82-ae5f097ffac0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.573974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] The token cache is being invalidate because project fd0c87091ca240cea6fb09bf8c6c60ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:17.574276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.575143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-83f51e04-28fb-4d62-8b82-ae5f097ffac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:17.576984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1217/2479] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:17 2022] DELETE /identity/v3/projects/fd0c87091ca240cea6fb09bf8c6c60ef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:36:17.581852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.582152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.582431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.601013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:17.602439 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:17.673869 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1263/2480] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:17.681536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.681837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.682124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.700970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:17.702225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:17.710725 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1218/2481] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:17.714918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.725331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48159ed1-40b1-492f-bbe4-d718c950e353 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:17.730258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:17.730922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.731209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.731488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.732307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:17.733911 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:17.735154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:17.751164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1264/2482] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:36:17.752004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.756774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:17.763144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc214406-83f7-4c4d-b635-a4e1c3d21c71 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:17.772037 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:17.772905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.773200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.773487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.774386 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:17.777328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:17.809344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1219/2483] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:17 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:36:17.813494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.823618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b87c3-62b7-4cc3-af0e-5a9328a2a495 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:17.876653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:17.896205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:17.896874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.897156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.897429 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.898115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:17.900576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:17.927444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1265/2484] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:17 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:17.931527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.942261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6f099-4e25-4845-a87f-17f041e9f8b3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:17.955729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:17.956683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:17.956820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:17.957340 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:17.957943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:17.959607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:17.977017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1220/2485] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:17.984332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:17.995586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d27e6-1778-40e0-bfcc-205a1be79eb1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.000755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2ed25-9d2f-41f6-820a-5c0a567c25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.001430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2ed25-9d2f-41f6-820a-5c0a567c25fd admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.001722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2ed25-9d2f-41f6-820a-5c0a567c25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.002006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2ed25-9d2f-41f6-820a-5c0a567c25fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.002926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2ed25-9d2f-41f6-820a-5c0a567c25fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.004595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2ed25-9d2f-41f6-820a-5c0a567c25fd admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.016050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1266/2486] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:18.020192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.030886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2f62-e924-4d65-9311-b8887afc0dcb admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.039967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.040886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.041181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.041473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] PATH_INFO: `/v3/projects/908cc342365141c382c905438eb1c014/users/4ea23ccf713443feb713675338c3ec6f/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.058337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908cc342365141c382c905438eb1c014, user_id=4ea23ccf713443feb713675338c3ec6f, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.061294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.074661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1221/2487] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:18 2022] PUT /identity/v3/projects/908cc342365141c382c905438eb1c014/users/4ea23ccf713443feb713675338c3ec6f/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:18.085288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.085784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.085929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.114555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] MFA Rules not processed for user `4ea23ccf713443feb713675338c3ec6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:18.115761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:18.180226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1267/2488] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:18.184579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.251837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fca6-5a06-4168-8731-39f321542f58 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.256536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.257473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.257799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.258123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.259005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.261105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.294198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1222/2489] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:18 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:18.295545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.306682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182aad-1dfd-4016-8cec-8abc81b6de6f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.379797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.380532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.380984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.381277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.381995 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.383996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.412203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1268/2490] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:18 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:36:18.413404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.424220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0266-ca3b-4284-8d64-9ea52deb0f41 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.428948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.429599 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.429900 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.430180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.430976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.432559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.450862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1223/2491] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:18.452991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.463051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd556a9-84af-4824-8e78-4fd2fdb4e3a1 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.468601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.469496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.469790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.470130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] PATH_INFO: `/v3/projects/5573cc4348f0491483767e0fbe624f5a/users/f67d9a62aff943a1a7cb90f4a672db01/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.487065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5573cc4348f0491483767e0fbe624f5a, user_id=f67d9a62aff943a1a7cb90f4a672db01, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.490210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.504528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1269/2492] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:18 2022] PUT /identity/v3/projects/5573cc4348f0491483767e0fbe624f5a/users/f67d9a62aff943a1a7cb90f4a672db01/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:36:18.508302 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.519996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c23d8-9ad8-415b-addb-48fe47a4b6f8 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.597966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc12be3-b3ed-4f3c-ad28-b5fe89328e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.598656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc12be3-b3ed-4f3c-ad28-b5fe89328e0d admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.598953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc12be3-b3ed-4f3c-ad28-b5fe89328e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.599242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc12be3-b3ed-4f3c-ad28-b5fe89328e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.600222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc12be3-b3ed-4f3c-ad28-b5fe89328e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.602328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc12be3-b3ed-4f3c-ad28-b5fe89328e0d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.616157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1224/2493] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:36:18.620295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.632260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90225c4-43f3-48c0-9a06-e5f8b02035c7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.637327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.638358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.638727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.639715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] PATH_INFO: `/v3/projects/5573cc4348f0491483767e0fbe624f5a/users/f67d9a62aff943a1a7cb90f4a672db01/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.641963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5573cc4348f0491483767e0fbe624f5a, user_id=f67d9a62aff943a1a7cb90f4a672db01, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.645057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.657994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1270/2494] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:18 2022] PUT /identity/v3/projects/5573cc4348f0491483767e0fbe624f5a/users/f67d9a62aff943a1a7cb90f4a672db01/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:36:18.669678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.670064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.670436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.704974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] MFA Rules not processed for user `f67d9a62aff943a1a7cb90f4a672db01`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:18.706221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:18.711397 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:18.808677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1225/2495] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:18.820295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:18.822510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:18.834777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:18.902755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e078a-49ac-45b6-8d5e-3fae8e85e43e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:18.908304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:18.909025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:18.909907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:18.910205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:18.921704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:18.923174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:18.934395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1271/2496] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:19.149287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:19.206681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:19.208277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:19.244824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9676d52-f545-4598-afbc-c2e69da37351 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:19.251999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:19.253010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:19.253395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:19.254488 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] PATH_INFO: `/v3/users/4ea23ccf713443feb713675338c3ec6f` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:19.255751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea23ccf713443feb713675338c3ec6f)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:19.258109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:19.281943 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed0d55-89e4-40ab-858d-d862070b5512 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:19.287737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:19.289334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:19.289708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:19.289916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] PATH_INFO: `/v3/users/b5fca77cf7b34fa89bb37048cc44eb86` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:19.291267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fca77cf7b34fa89bb37048cc44eb86)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:19.293414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:19.319644 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea23ccf713443feb713675338c3ec6f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.328752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea23ccf713443feb713675338c3ec6f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.336367 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea23ccf713443feb713675338c3ec6f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.336979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea23ccf713443feb713675338c3ec6f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.337697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-34087734-8d80-4ca3-8e1d-397767a2063a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea23ccf713443feb713675338c3ec6f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.350531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fca77cf7b34fa89bb37048cc44eb86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.356892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1226/2497] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:19 2022] DELETE /identity/v3/users/4ea23ccf713443feb713675338c3ec6f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:19.360480 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fca77cf7b34fa89bb37048cc44eb86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.361786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:19.362084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:19.362372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:19.366919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fca77cf7b34fa89bb37048cc44eb86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.367589 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fca77cf7b34fa89bb37048cc44eb86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.368211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fca77cf7b34fa89bb37048cc44eb86'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.380909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:19.382670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:19.386822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1272/2498] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:19 2022] DELETE /identity/v3/users/b5fca77cf7b34fa89bb37048cc44eb86 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:19.399163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:19.452445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1227/2499] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:19.462162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:19.463502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:19.498451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:19.527058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5d647-b496-4ed8-be20-9cf8ccb78c6a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:19.531012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:19.531653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:19.531969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:19.532253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:19.570721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:19.572283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:19.585232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365141-7f48-4d20-b801-3ee1219f5664 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:19.609195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:19.610799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:19.621050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1273/2500] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:19.646166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:19.647036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:19.647326 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:19.647611 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] PATH_INFO: `/v3/projects/9f46c2ebfa5d4d90b4bc640c0c44daa1` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:19.648833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f46c2ebfa5d4d90b4bc640c0c44daa1)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:19.650751 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:19.700332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f46c2ebfa5d4d90b4bc640c0c44daa1', 'request_id': 'req-73406cf3-90b4-4270-b143-ece2743b4dd7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.706282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f46c2ebfa5d4d90b4bc640c0c44daa1', 'request_id': 'req-73406cf3-90b4-4270-b143-ece2743b4dd7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.712722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f46c2ebfa5d4d90b4bc640c0c44daa1', 'request_id': 'req-73406cf3-90b4-4270-b143-ece2743b4dd7'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.727058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] The token cache is being invalidate because project 9f46c2ebfa5d4d90b4bc640c0c44daa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:19.727480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.728238 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.730795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1228/2501] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:19 2022] DELETE /identity/v3/projects/9f46c2ebfa5d4d90b4bc640c0c44daa1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:19.736328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:19.746731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1c92-25ee-46bd-827e-186dd497792c service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:19.811667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:19.812576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:19.812860 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:19.813144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] PATH_INFO: `/v3/users/59895837b0fa418787f8ec792e8a6616` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:19.814353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59895837b0fa418787f8ec792e8a6616)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:19.816328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:19.867633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59895837b0fa418787f8ec792e8a6616'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.875868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59895837b0fa418787f8ec792e8a6616'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.883441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59895837b0fa418787f8ec792e8a6616'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.884186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59895837b0fa418787f8ec792e8a6616'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.884822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59895837b0fa418787f8ec792e8a6616'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:19.902712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:19.911091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:19.914000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1274/2502] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:19 2022] DELETE /identity/v3/users/59895837b0fa418787f8ec792e8a6616 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:19.914126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:19.927862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73406cf3-90b4-4270-b143-ece2743b4dd7 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:19.988798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:20.002324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:20.003641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.003989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.004514 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] PATH_INFO: `/v3/projects/908cc342365141c382c905438eb1c014` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.006185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908cc342365141c382c905438eb1c014)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:20.008173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:20.064546 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908cc342365141c382c905438eb1c014', 'request_id': 'req-24ce71ee-8a6c-4431-a12d-e277a5353331'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.070513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908cc342365141c382c905438eb1c014', 'request_id': 'req-24ce71ee-8a6c-4431-a12d-e277a5353331'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.077894 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908cc342365141c382c905438eb1c014', 'request_id': 'req-24ce71ee-8a6c-4431-a12d-e277a5353331'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.090628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] The token cache is being invalidate because project 908cc342365141c382c905438eb1c014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:20.090957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.091613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.093370 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1229/2503] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:19 2022] DELETE /identity/v3/projects/908cc342365141c382c905438eb1c014 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:36:20.097457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:20.098908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:20.101039 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:20.102468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:20.113214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407873d-544a-4c89-8085-7ed9a43b3218 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:20.171551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce71ee-8a6c-4431-a12d-e277a5353331 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:20.176614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:20.177492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.177784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.178074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] PATH_INFO: `/v3/projects/5d447f52ac3c40d59bf8cec7b5a05467` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.179266 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d447f52ac3c40d59bf8cec7b5a05467)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:20.181714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:20.187595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:20.188496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.188781 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.189057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] PATH_INFO: `/v3/users/f67d9a62aff943a1a7cb90f4a672db01` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.190271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67d9a62aff943a1a7cb90f4a672db01)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:20.192199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:20.230703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d447f52ac3c40d59bf8cec7b5a05467', 'request_id': 'req-4b6e56e7-82f4-409e-9f8c-2b763155201f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.237607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d447f52ac3c40d59bf8cec7b5a05467', 'request_id': 'req-4b6e56e7-82f4-409e-9f8c-2b763155201f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.239557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67d9a62aff943a1a7cb90f4a672db01'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.243739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d447f52ac3c40d59bf8cec7b5a05467', 'request_id': 'req-4b6e56e7-82f4-409e-9f8c-2b763155201f'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.247044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67d9a62aff943a1a7cb90f4a672db01'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.255902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67d9a62aff943a1a7cb90f4a672db01'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.256607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67d9a62aff943a1a7cb90f4a672db01'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.257359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] The token cache is being invalidate because project 5d447f52ac3c40d59bf8cec7b5a05467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:20.257532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b769633e-9fb4-4436-817b-a69971903e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67d9a62aff943a1a7cb90f4a672db01'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.257881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.258666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.260289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1230/2504] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:20 2022] DELETE /identity/v3/projects/5d447f52ac3c40d59bf8cec7b5a05467 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:20.280796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1275/2505] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:20 2022] DELETE /identity/v3/users/f67d9a62aff943a1a7cb90f4a672db01 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:20.577934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:20.579403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:20.593978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:20.650431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e56e7-82f4-409e-9f8c-2b763155201f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:20.706819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:20.708081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.708371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.708651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] PATH_INFO: `/v3/projects/5573cc4348f0491483767e0fbe624f5a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.709847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5573cc4348f0491483767e0fbe624f5a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:20.711745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:20.756738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5573cc4348f0491483767e0fbe624f5a', 'request_id': 'req-001e1765-ef1c-467b-8abd-3f88567e72a3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.762537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5573cc4348f0491483767e0fbe624f5a', 'request_id': 'req-001e1765-ef1c-467b-8abd-3f88567e72a3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.769382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5573cc4348f0491483767e0fbe624f5a', 'request_id': 'req-001e1765-ef1c-467b-8abd-3f88567e72a3'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.781738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] The token cache is being invalidate because project 5573cc4348f0491483767e0fbe624f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:20.782027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.782646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-001e1765-ef1c-467b-8abd-3f88567e72a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:20.784232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1231/2506] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:20 2022] DELETE /identity/v3/projects/5573cc4348f0491483767e0fbe624f5a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:20.789128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.789428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.789732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.807246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:20.808491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:20.867308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1276/2507] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:20.875727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.876055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.876336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.894737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:20.895990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:20.904915 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1232/2508] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:20.909170 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:20.918651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3e34-940b-4ee4-b4e4-c3d0b6144b6a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:20.923340 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:20.924019 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.924308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.924586 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.925302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:20.925608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:20.927191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:20.939229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1277/2509] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:36:20.943444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:20.954041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c491-57df-4b21-a2b0-abb3ad624378 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:20.958733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:20.959413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:20.959701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:20.960018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:20.960716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:20.962613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:20.989658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1233/2510] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:20 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:36:20.993722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.001268 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:21.007153 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44926d-d233-4267-a65b-2756f301b7e9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.066786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.067485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.067773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.068090 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.068796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.070733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.089706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1278/2511] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:20 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:21.094765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.106481 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdbb64-61f2-4f64-9898-d61294b33fc6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.112532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.113201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.113487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.113768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.114496 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.116120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.127081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1234/2512] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:21.131057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.141534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35aff7d-9ae4-4f33-865d-3ccb3458179a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.146162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d76f8-7165-460e-a62f-41462b0f36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.146819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d76f8-7165-460e-a62f-41462b0f36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.147110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d76f8-7165-460e-a62f-41462b0f36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.147392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d76f8-7165-460e-a62f-41462b0f36b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.148152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d76f8-7165-460e-a62f-41462b0f36b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.149754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d76f8-7165-460e-a62f-41462b0f36b8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.159752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1279/2513] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:21.164123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.174789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57920-03de-45b6-9e8f-9e947f87cda6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.179368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.180383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.180670 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.180950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] PATH_INFO: `/v3/projects/a3fa8d6a87a04af3bd524515d00682c0/users/34bb302b926f4032902171fa1a6f1597/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.183978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:21.198783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fa8d6a87a04af3bd524515d00682c0, user_id=34bb302b926f4032902171fa1a6f1597, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.202198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.214656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1235/2514] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:21 2022] PUT /identity/v3/projects/a3fa8d6a87a04af3bd524515d00682c0/users/34bb302b926f4032902171fa1a6f1597/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:21.226655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.226978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.227267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.253726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] MFA Rules not processed for user `34bb302b926f4032902171fa1a6f1597`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:21.254929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:21.318355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1280/2515] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:21.322839 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.384004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792779ef-7cc7-4f7f-8b7c-49e3bc5652ba admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.388617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.389830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.390252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.390534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.391212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.393136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.421730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1236/2516] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:21 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:21.425289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.436559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba836d1-ff87-4e2c-8b3b-632c807ca4b4 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.495557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.496262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.496556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.496844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.497540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.499605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.518328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1281/2517] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:21 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:21.522523 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.533439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ca83-d3ab-4633-bf5f-48b38ff3c749 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.538237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.538969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.539261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.539538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.540350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.541983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.553085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1237/2518] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:36:21.557209 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.562903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:21.568783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6160dd-28ee-491b-82f5-6fec116870e7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.574188 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.575070 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.575356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.575638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] PATH_INFO: `/v3/projects/87567deb86d246728417db9087a2e31a/users/6261d4809cd54c668d96b1718a0e7b75/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.590989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87567deb86d246728417db9087a2e31a, user_id=6261d4809cd54c668d96b1718a0e7b75, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.594387 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.606698 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1282/2519] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:21 2022] PUT /identity/v3/projects/87567deb86d246728417db9087a2e31a/users/6261d4809cd54c668d96b1718a0e7b75/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:21.611041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.620940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb699f-e4a5-44aa-adc5-b1434b01d90e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.679460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5b97-f442-4b66-98e2-fe272938c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.680161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5b97-f442-4b66-98e2-fe272938c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.680470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5b97-f442-4b66-98e2-fe272938c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.680740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5b97-f442-4b66-98e2-fe272938c9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.681559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5b97-f442-4b66-98e2-fe272938c9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.683252 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5b97-f442-4b66-98e2-fe272938c9bc admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.694880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1238/2520] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:21.698930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.709985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161d18-049a-4591-a28f-e63540646fa3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.714646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.715518 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.715801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.716112 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] PATH_INFO: `/v3/projects/87567deb86d246728417db9087a2e31a/users/6261d4809cd54c668d96b1718a0e7b75/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.718420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87567deb86d246728417db9087a2e31a, user_id=6261d4809cd54c668d96b1718a0e7b75, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.721146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.731142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1283/2521] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:21 2022] PUT /identity/v3/projects/87567deb86d246728417db9087a2e31a/users/6261d4809cd54c668d96b1718a0e7b75/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:21.741821 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.742123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.742409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.769240 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] MFA Rules not processed for user `6261d4809cd54c668d96b1718a0e7b75`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:21.770492 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:21.814454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:21.839231 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1239/2522] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:21.850369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:21.852086 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:21.909186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81063-8122-40b5-b314-caceaa389e84 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:21.913025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:21.913657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:21.913969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:21.914250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:21.923585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:21.925055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:21.934399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1284/2523] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:22.007594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:22.017524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b07c-6a53-4f37-8228-ff9a9054f141 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:22.021180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0851-ad46-43a4-be91-77e837724409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:22.021822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0851-ad46-43a4-be91-77e837724409 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:22.022114 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0851-ad46-43a4-be91-77e837724409 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:22.022400 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0851-ad46-43a4-be91-77e837724409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:22.081080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0851-ad46-43a4-be91-77e837724409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:22.082517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0851-ad46-43a4-be91-77e837724409 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:22.091578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1240/2524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:28.792868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:28.854225 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944a7c5-2da4-4841-a73e-4c8102c1a767 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:28.858975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:28.859839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:28.860200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:28.860483 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] PATH_INFO: `/v3/users/34bb302b926f4032902171fa1a6f1597` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:28.861694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bb302b926f4032902171fa1a6f1597)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:28.863600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:28.910996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bb302b926f4032902171fa1a6f1597'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:28.919006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bb302b926f4032902171fa1a6f1597'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:28.926823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bb302b926f4032902171fa1a6f1597'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:28.927459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bb302b926f4032902171fa1a6f1597'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:28.928089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bb302b926f4032902171fa1a6f1597'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:28.933479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:28.946909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1285/2525] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:28 2022] DELETE /identity/v3/users/34bb302b926f4032902171fa1a6f1597 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:28.951524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:28.952061 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:28.952168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:28.970873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:28.972284 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:29.030445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1241/2526] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:29.040917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:29.042315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:29.101353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6730f-6fcc-4ea1-8230-9f18da9d753d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:29.105012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:29.105660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:29.105949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:29.106229 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:29.116236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:29.117715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:29.128220 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1286/2527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:36:29.402356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:29.403794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:29.417360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf71a-2654-40a1-9a6a-42d4b1341f6b None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:29.422044 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:29.423720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:29.424051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:29.424336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] PATH_INFO: `/v3/projects/a3fa8d6a87a04af3bd524515d00682c0` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:29.425609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fa8d6a87a04af3bd524515d00682c0)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:29.427511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:29.476208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fa8d6a87a04af3bd524515d00682c0', 'request_id': 'req-29db87bf-b147-40d2-bd2e-795540c16218'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.481482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fa8d6a87a04af3bd524515d00682c0', 'request_id': 'req-29db87bf-b147-40d2-bd2e-795540c16218'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.488526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fa8d6a87a04af3bd524515d00682c0', 'request_id': 'req-29db87bf-b147-40d2-bd2e-795540c16218'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.501601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] The token cache is being invalidate because project a3fa8d6a87a04af3bd524515d00682c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:29.501770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.502313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.503847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1242/2528] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:29 2022] DELETE /identity/v3/projects/a3fa8d6a87a04af3bd524515d00682c0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:29.508042 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:29.518018 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefcba8-77f3-4397-b433-39c1dd118291 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:29.574908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:29.575795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:29.576117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:29.576402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] PATH_INFO: `/v3/users/6261d4809cd54c668d96b1718a0e7b75` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:29.577643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6261d4809cd54c668d96b1718a0e7b75)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:29.580124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:29.627578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6261d4809cd54c668d96b1718a0e7b75'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.634913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6261d4809cd54c668d96b1718a0e7b75'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.642147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6261d4809cd54c668d96b1718a0e7b75'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.642769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6261d4809cd54c668d96b1718a0e7b75'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.643369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-8fdb1287-2ffc-4a3f-bfda-95d2fa4f3b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6261d4809cd54c668d96b1718a0e7b75'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:29.661177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1287/2529] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:29 2022] DELETE /identity/v3/users/6261d4809cd54c668d96b1718a0e7b75 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:29.937445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:29.938868 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:29.946666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:29.952712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db87bf-b147-40d2-bd2e-795540c16218 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.013225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.014011 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.014303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.014589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] PATH_INFO: `/v3/projects/87567deb86d246728417db9087a2e31a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.015766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87567deb86d246728417db9087a2e31a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.018259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.067265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87567deb86d246728417db9087a2e31a', 'request_id': 'req-81314959-702c-4210-a11b-8d2bc2989a30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:30.072992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87567deb86d246728417db9087a2e31a', 'request_id': 'req-81314959-702c-4210-a11b-8d2bc2989a30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:30.079960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87567deb86d246728417db9087a2e31a', 'request_id': 'req-81314959-702c-4210-a11b-8d2bc2989a30'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:30.092951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] The token cache is being invalidate because project 87567deb86d246728417db9087a2e31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:30.093245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:30.093892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-81314959-702c-4210-a11b-8d2bc2989a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:30.096123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1243/2530] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:29 2022] DELETE /identity/v3/projects/87567deb86d246728417db9087a2e31a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:30.100978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.101453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.101551 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.119311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:30.120549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:30.126051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:30.184472 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1288/2531] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:30.192395 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.192712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.192996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.212031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:30.213228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:30.222251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1244/2532] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:30.226334 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.236242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61d151-eb48-4f22-b11a-d78646fb238f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.240778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164681ba-531e-4366-906f-021b23079664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.241404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164681ba-531e-4366-906f-021b23079664 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.241690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164681ba-531e-4366-906f-021b23079664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.241968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164681ba-531e-4366-906f-021b23079664 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.242682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164681ba-531e-4366-906f-021b23079664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:30.243016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164681ba-531e-4366-906f-021b23079664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.244639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164681ba-531e-4366-906f-021b23079664 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.256005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1289/2533] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:36:30.260347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.270211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185cf39-af5a-4d72-a656-1671924c7288 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.274794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.275666 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.276006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.276292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.276983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.278892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.304786 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1245/2534] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:30.308831 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164681ba-531e-4366-906f-021b23079664 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.319987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164681ba-531e-4366-906f-021b23079664 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.376732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.377403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.377695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.377976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.378673 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.380660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.401398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1290/2535] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:36:30.405845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.416393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556da1ee-c6c2-4e41-8fe8-2dbb0f5702f4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.421084 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.421742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.422032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.422366 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.423338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.424992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.435396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1246/2536] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:30.439854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.449948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e706b7e-0299-4f3b-8905-196a402a7a90 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.455282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa0fbe-7960-4a3d-9e3b-df4e53435d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.455972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0fbe-7960-4a3d-9e3b-df4e53435d59 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.456267 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0fbe-7960-4a3d-9e3b-df4e53435d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.456555 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0fbe-7960-4a3d-9e3b-df4e53435d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.457317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa0fbe-7960-4a3d-9e3b-df4e53435d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.458926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa0fbe-7960-4a3d-9e3b-df4e53435d59 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.468739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1291/2537] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:36:30.473145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.484243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7409c-a9bb-493b-b9f0-357f43219d36 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.489345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.490236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.490520 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.490797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] PATH_INFO: `/v3/projects/eab50aecb9934645a88bc136f29dc7d0/users/b0724fea3c6c4e68bf347b74c99ab318/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.505765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab50aecb9934645a88bc136f29dc7d0, user_id=b0724fea3c6c4e68bf347b74c99ab318, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.508436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.521643 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1247/2538] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:30 2022] PUT /identity/v3/projects/eab50aecb9934645a88bc136f29dc7d0/users/b0724fea3c6c4e68bf347b74c99ab318/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:30.532398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.532696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.532984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.559386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] MFA Rules not processed for user `b0724fea3c6c4e68bf347b74c99ab318`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:30.560657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:30.624454 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1292/2539] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:30.629477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.661260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:30.695456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e1c2-da56-4db6-b18f-522444a40e97 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.700102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.700752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.701035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.701314 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.701990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.704082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.728992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1248/2540] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:30.733062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.740384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:30.745438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bab3f3-a452-432b-8a03-537896b99a76 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.804375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.804970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.805410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.805694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.806381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.808506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.828147 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1293/2541] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:30 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:30.832512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.842722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a9e6-0d4a-4835-9afa-c7dea2e0d435 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.847726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.848398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.848682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.848959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.849676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.851292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.862736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1249/2542] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:30.866708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.877814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf63c1-8859-4531-9667-b2e814f1fa45 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.882524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.883399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.883691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.884021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] PATH_INFO: `/v3/projects/4a3f4f8f44c6471399196677be4de9b9/users/5bf73e591dee4ec5aa6c12ad25bc2838/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.898788 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3f4f8f44c6471399196677be4de9b9, user_id=5bf73e591dee4ec5aa6c12ad25bc2838, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.901481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:30.914871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1294/2543] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:30 2022] PUT /identity/v3/projects/4a3f4f8f44c6471399196677be4de9b9/users/5bf73e591dee4ec5aa6c12ad25bc2838/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:36:30.918838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:30.930027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2807e9-f0a2-4d91-8f15-be9de40727d4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:30.988251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534627e-d389-4914-bcf5-854dc62c6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:30.988937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534627e-d389-4914-bcf5-854dc62c6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:30.989229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534627e-d389-4914-bcf5-854dc62c6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:30.989515 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534627e-d389-4914-bcf5-854dc62c6b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:30.990297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534627e-d389-4914-bcf5-854dc62c6b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:30.992027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534627e-d389-4914-bcf5-854dc62c6b65 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:31.003677 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1250/2544] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:31.007886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:31.018820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c353bd-596c-4508-9c2e-c7a6cac7496e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:31.023356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:31.024259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:31.024548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:31.024828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] PATH_INFO: `/v3/projects/4a3f4f8f44c6471399196677be4de9b9/users/5bf73e591dee4ec5aa6c12ad25bc2838/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:31.026782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3f4f8f44c6471399196677be4de9b9, user_id=5bf73e591dee4ec5aa6c12ad25bc2838, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:31.029443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:31.040078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1295/2545] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:31 2022] PUT /identity/v3/projects/4a3f4f8f44c6471399196677be4de9b9/users/5bf73e591dee4ec5aa6c12ad25bc2838/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:31.050158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:31.050456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:31.050739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:31.078125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] MFA Rules not processed for user `5bf73e591dee4ec5aa6c12ad25bc2838`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:31.080040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:31.150076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1251/2546] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:31.161243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:31.162976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:31.219886 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19115-9052-491a-9387-b617bef20b91 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:31.223528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71656c6-e248-454d-81fc-34c5a59068d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:31.224195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71656c6-e248-454d-81fc-34c5a59068d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:31.224485 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71656c6-e248-454d-81fc-34c5a59068d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:31.224772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71656c6-e248-454d-81fc-34c5a59068d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:31.234198 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71656c6-e248-454d-81fc-34c5a59068d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:31.236201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71656c6-e248-454d-81fc-34c5a59068d3 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:31.245614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1296/2547] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:31.622742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:31.649923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:31.689229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f308-0982-40e1-a3c1-ef6509674be5 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:31.695552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:31.697148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:31.697473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:31.697765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] PATH_INFO: `/v3/users/b0724fea3c6c4e68bf347b74c99ab318` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:31.699254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0724fea3c6c4e68bf347b74c99ab318)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:31.701369 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:31.752855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0724fea3c6c4e68bf347b74c99ab318'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:31.761845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0724fea3c6c4e68bf347b74c99ab318'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:31.770195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0724fea3c6c4e68bf347b74c99ab318'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:31.770849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0724fea3c6c4e68bf347b74c99ab318'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:31.771706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0724fea3c6c4e68bf347b74c99ab318'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:31.794392 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1252/2548] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:31 2022] DELETE /identity/v3/users/b0724fea3c6c4e68bf347b74c99ab318 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:31.796371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:31.796669 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:31.796956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:31.816382 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:31.817624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:31.867364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:31.877057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1297/2549] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:31.886535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:31.887995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:31.945996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cbd54-ed51-4055-9266-4bf843baa6ff admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:31.949653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:31.950293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:31.950579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:31.950856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:31.960398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:31.961810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:31.971425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1253/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:32.245493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:32.247448 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:32.260899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf8e72-244b-4d27-8fa3-a8034b0ead4b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:32.265851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:32.267507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:32.267507 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:32.267722 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] PATH_INFO: `/v3/projects/eab50aecb9934645a88bc136f29dc7d0` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:32.268822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab50aecb9934645a88bc136f29dc7d0)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:32.271012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:32.318081 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab50aecb9934645a88bc136f29dc7d0', 'request_id': 'req-d0557ca2-75b8-4724-8ee1-812ae662341b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.323572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab50aecb9934645a88bc136f29dc7d0', 'request_id': 'req-d0557ca2-75b8-4724-8ee1-812ae662341b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.329598 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab50aecb9934645a88bc136f29dc7d0', 'request_id': 'req-d0557ca2-75b8-4724-8ee1-812ae662341b'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.341584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] The token cache is being invalidate because project eab50aecb9934645a88bc136f29dc7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:32.341874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.342497 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.344065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1298/2551] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:32 2022] DELETE /identity/v3/projects/eab50aecb9934645a88bc136f29dc7d0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:32.348092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:32.357858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643181-dc7c-41c0-9d22-b0994fce74b6 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:32.402690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:32.417067 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:32.417940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:32.418223 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:32.418502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] PATH_INFO: `/v3/users/5bf73e591dee4ec5aa6c12ad25bc2838` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:32.419676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf73e591dee4ec5aa6c12ad25bc2838)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:32.421739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:32.466106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf73e591dee4ec5aa6c12ad25bc2838'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.473449 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf73e591dee4ec5aa6c12ad25bc2838'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.484691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf73e591dee4ec5aa6c12ad25bc2838'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.485324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf73e591dee4ec5aa6c12ad25bc2838'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.485954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-a152b75e-089a-4f61-a52d-a75192a533da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf73e591dee4ec5aa6c12ad25bc2838'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.504149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1254/2552] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:32 2022] DELETE /identity/v3/users/5bf73e591dee4ec5aa6c12ad25bc2838 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:32.772210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:32.774020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:32.787679 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0557ca2-75b8-4724-8ee1-812ae662341b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:32.843807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:32.844687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:32.844970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:32.845246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] PATH_INFO: `/v3/projects/4a3f4f8f44c6471399196677be4de9b9` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:32.846819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3f4f8f44c6471399196677be4de9b9)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:32.848761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:32.894918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3f4f8f44c6471399196677be4de9b9', 'request_id': 'req-982b6601-d694-4b4e-8537-d105a2cc9dbd'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.900262 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3f4f8f44c6471399196677be4de9b9', 'request_id': 'req-982b6601-d694-4b4e-8537-d105a2cc9dbd'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.906728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3f4f8f44c6471399196677be4de9b9', 'request_id': 'req-982b6601-d694-4b4e-8537-d105a2cc9dbd'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.919184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] The token cache is being invalidate because project 4a3f4f8f44c6471399196677be4de9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:32.919471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.920126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-982b6601-d694-4b4e-8537-d105a2cc9dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:32.921646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1299/2553] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:32 2022] DELETE /identity/v3/projects/4a3f4f8f44c6471399196677be4de9b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:32.926665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:32.926983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:32.927262 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:32.945485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:32.946658 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:33.006784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1255/2554] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:33.014402 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.014694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.014976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.034322 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:33.035514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:33.043288 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1300/2555] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:33.047331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.056980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1ba57-3452-40ea-835d-a75f7450f1a6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.061607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.062263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.062549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.062828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.063551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:33.063859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.065631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.077432 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1256/2556] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:36:33.082244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.091571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33abb9b-ec72-4bba-820f-9e2fc8a00d8c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.097024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.097675 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.097965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.098247 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.098945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.100892 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.104085 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:33.128611 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1301/2557] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:33.132738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.143157 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bdc9d-0d14-4ea3-abd6-863df63fd4a9 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.192180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:33.202689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.203330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.203618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.203929 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.204632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.207151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.226426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1257/2558] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:33.230579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.241645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad460b-c260-43d6-857d-3a7f2926a117 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.246234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.246885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.247172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.247453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.248223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.249819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.260570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1302/2559] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:33.264379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.275189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fbea8-e5f6-479c-921d-93a2b29670ef admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.279831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026dc75-abb7-4023-a525-db449a5d490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.280632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026dc75-abb7-4023-a525-db449a5d490a admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.280944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026dc75-abb7-4023-a525-db449a5d490a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.281228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026dc75-abb7-4023-a525-db449a5d490a admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.281957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026dc75-abb7-4023-a525-db449a5d490a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.284155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026dc75-abb7-4023-a525-db449a5d490a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.293979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1258/2560] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:33.297970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.308015 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c796b14-8873-46be-8d3e-6cda437ae628 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.312530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.313393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.313676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.313950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] PATH_INFO: `/v3/projects/141280e1238946c9959bd7528ffc447e/users/ac2691805b0f45bb9db809f9d9f55722/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.328936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] RBAC: Authorizing `identity:create_grant(project_id=141280e1238946c9959bd7528ffc447e, user_id=ac2691805b0f45bb9db809f9d9f55722, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.332411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.344819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1303/2561] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:33 2022] PUT /identity/v3/projects/141280e1238946c9959bd7528ffc447e/users/ac2691805b0f45bb9db809f9d9f55722/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:33.355978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.356499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.356615 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.384350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] MFA Rules not processed for user `ac2691805b0f45bb9db809f9d9f55722`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:33.385556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:33.449926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1259/2562] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:33.454419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.524536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99db980-683f-422c-b065-eaa27daa274c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.529216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.529872 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.530159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.530441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.531152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.533118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.557332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1304/2563] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:33.561501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.572986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2f965-3d36-4cb4-8635-94786ccd98e0 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.629517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.630178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.630469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.630753 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.631441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.633387 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.656298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1260/2564] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:36:33.657785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.668635 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a6f40-7157-4ba2-985d-cfaf925f5810 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.673228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.674059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.674508 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.674795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.675523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.677207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.687531 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1305/2565] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:33.691882 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.701638 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3812d56-f4fa-4939-9dce-65f53029bb3a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.706803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.707639 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.707959 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.708243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] PATH_INFO: `/v3/projects/effa1d01b022458ba3e7f93e561ff234/users/7aa884cae8cf4f8d8fa8e6b5fae181bb/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.724705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effa1d01b022458ba3e7f93e561ff234, user_id=7aa884cae8cf4f8d8fa8e6b5fae181bb, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.727331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.741192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1261/2566] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:33 2022] PUT /identity/v3/projects/effa1d01b022458ba3e7f93e561ff234/users/7aa884cae8cf4f8d8fa8e6b5fae181bb/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:33.745111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.755528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21eb93-c5ab-4c95-a98c-15c82599ee00 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.819678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d466-7293-4610-b749-d138cf7bbb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.820381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d466-7293-4610-b749-d138cf7bbb20 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.820672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d466-7293-4610-b749-d138cf7bbb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.821001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d466-7293-4610-b749-d138cf7bbb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.821731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d466-7293-4610-b749-d138cf7bbb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.823328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d466-7293-4610-b749-d138cf7bbb20 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.833765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1306/2567] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:33.837909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.848794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9a045-2af7-45c8-b904-cb7eb6ddddd2 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:33.853406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:33.854280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.854592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.854850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] PATH_INFO: `/v3/projects/effa1d01b022458ba3e7f93e561ff234/users/7aa884cae8cf4f8d8fa8e6b5fae181bb/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.856826 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effa1d01b022458ba3e7f93e561ff234, user_id=7aa884cae8cf4f8d8fa8e6b5fae181bb, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:33.859706 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:33.869920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1262/2568] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:33 2022] PUT /identity/v3/projects/effa1d01b022458ba3e7f93e561ff234/users/7aa884cae8cf4f8d8fa8e6b5fae181bb/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:33.879682 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:33.880010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:33.880299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:33.906844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] MFA Rules not processed for user `7aa884cae8cf4f8d8fa8e6b5fae181bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:33.908670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:33.916785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:33.976550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1307/2569] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:33.987793 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:33.989517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:34.004176 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:34.046770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68eac1-eacc-484d-b16f-7a4fb6c851f7 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:34.051007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:34.051653 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:34.052463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:34.052463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:34.061630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:34.063077 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:34.073399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1263/2570] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:34.118068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:34.119474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:34.132189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7395abe-c640-408a-923f-cfcc2012bc48 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:34.136061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3fbd9-f456-4c78-9a72-a78a8e67f217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:34.136696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3fbd9-f456-4c78-9a72-a78a8e67f217 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:34.136981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3fbd9-f456-4c78-9a72-a78a8e67f217 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:34.137260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3fbd9-f456-4c78-9a72-a78a8e67f217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:34.197864 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3fbd9-f456-4c78-9a72-a78a8e67f217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:34.199297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3fbd9-f456-4c78-9a72-a78a8e67f217 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:34.209166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1308/2571] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:37.411195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:37.471835 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ea1e4-f5b9-4384-b362-c4635bdcdd36 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:37.476403 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:37.477260 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:37.477545 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:37.477815 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] PATH_INFO: `/v3/users/ac2691805b0f45bb9db809f9d9f55722` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:37.478988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2691805b0f45bb9db809f9d9f55722)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:37.480931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:37.526319 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2691805b0f45bb9db809f9d9f55722'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:37.533798 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2691805b0f45bb9db809f9d9f55722'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:37.540693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2691805b0f45bb9db809f9d9f55722'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:37.541317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2691805b0f45bb9db809f9d9f55722'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:37.541922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2691805b0f45bb9db809f9d9f55722'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:37.559354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1264/2572] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:37 2022] DELETE /identity/v3/users/ac2691805b0f45bb9db809f9d9f55722 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:37.563740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:37.564260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:37.564373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:37.581949 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:37.583175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:37.642189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1309/2573] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:37.652368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:37.653863 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:37.697720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:37.716892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19523064-4e42-4136-84db-0f95c604bd8b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:37.721641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:37.722299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:37.722589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:37.722871 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:37.732294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:37.733982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:37.745012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1265/2574] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:38.016810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.018393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:38.030320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90add62-97cd-4a61-a40a-927d56fee30f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.035423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.036368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.036716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.036924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] PATH_INFO: `/v3/projects/141280e1238946c9959bd7528ffc447e` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.038098 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141280e1238946c9959bd7528ffc447e)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.040027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:38.082315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:38.090381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141280e1238946c9959bd7528ffc447e', 'request_id': 'req-65463fa1-068f-4541-b4b0-2d03642a1577'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.095834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141280e1238946c9959bd7528ffc447e', 'request_id': 'req-65463fa1-068f-4541-b4b0-2d03642a1577'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.101963 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141280e1238946c9959bd7528ffc447e', 'request_id': 'req-65463fa1-068f-4541-b4b0-2d03642a1577'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.114794 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] The token cache is being invalidate because project 141280e1238946c9959bd7528ffc447e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:38.115055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.115694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.117271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1310/2575] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:38 2022] DELETE /identity/v3/projects/141280e1238946c9959bd7528ffc447e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:38.121228 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.131462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb65f93-aaed-4e96-8da1-f52369d71871 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.187251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.188158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.188439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.188712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] PATH_INFO: `/v3/users/7aa884cae8cf4f8d8fa8e6b5fae181bb` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.190633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa884cae8cf4f8d8fa8e6b5fae181bb)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.192601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:38.237586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa884cae8cf4f8d8fa8e6b5fae181bb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.244614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa884cae8cf4f8d8fa8e6b5fae181bb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.251451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa884cae8cf4f8d8fa8e6b5fae181bb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.252740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa884cae8cf4f8d8fa8e6b5fae181bb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.253359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa884cae8cf4f8d8fa8e6b5fae181bb'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.270360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1266/2576] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:38 2022] DELETE /identity/v3/users/7aa884cae8cf4f8d8fa8e6b5fae181bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:38.537460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.538894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:38.553187 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65463fa1-068f-4541-b4b0-2d03642a1577 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.612214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.613100 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.613395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.613678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] PATH_INFO: `/v3/projects/effa1d01b022458ba3e7f93e561ff234` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.614887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=effa1d01b022458ba3e7f93e561ff234)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.616957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:38.664777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effa1d01b022458ba3e7f93e561ff234', 'request_id': 'req-39555615-0b02-4fc4-9571-6742db3ca138'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.670758 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effa1d01b022458ba3e7f93e561ff234', 'request_id': 'req-39555615-0b02-4fc4-9571-6742db3ca138'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.679431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effa1d01b022458ba3e7f93e561ff234', 'request_id': 'req-39555615-0b02-4fc4-9571-6742db3ca138'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.686060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.687600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:38.693049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] The token cache is being invalidate because project effa1d01b022458ba3e7f93e561ff234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:38.693366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.694030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-39555615-0b02-4fc4-9571-6742db3ca138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:38.695641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1311/2577] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:38 2022] DELETE /identity/v3/projects/effa1d01b022458ba3e7f93e561ff234 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:38.700350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a3c62-a94f-42f1-a40c-8b6095036492 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.700647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a3c62-a94f-42f1-a40c-8b6095036492 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.700929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a3c62-a94f-42f1-a40c-8b6095036492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.718720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e74a3c62-a94f-42f1-a40c-8b6095036492 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:38.719973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e74a3c62-a94f-42f1-a40c-8b6095036492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:38.750614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:38.768579 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacc8e5-24f2-4d73-b6c9-99d875f7004f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.773759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:38.785350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1312/2578] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:38.793743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.794221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.794791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.812235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:38.813455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:38.822360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1313/2579] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:38.826126 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.833785 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.834448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.834738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.835023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.835741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a613578-50b3-4c9b-b43e-a0dc591821ab None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.837135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:38.840501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.841150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.841443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.841727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.842457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:38.842771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.844422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:38.848730 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.850336 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:38.860097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1314/2580] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:36:38.860977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1267/2581] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:36:38.861641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.871940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892cef-dae1-4352-bb3d-30af0cf91d18 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.876543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.877896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.878191 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.878505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.879194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.881158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:38.907583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1315/2582] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:38 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:38.911942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:38.922463 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87912-422b-4e66-b41c-541ef24094d9 service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:38.983982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:38.984694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:38.984945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:38.985234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:38.986620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:38.988594 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.009745 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1268/2583] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:38 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:39.013959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.024506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590bf32-e6bd-4de3-844d-68e826d1c6fb admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.029246 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.030025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.030180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.030457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.031177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.032792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.043409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1316/2584] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:39.047513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.058538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f86b82-7a25-417c-8386-703a6232e89a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.063315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d91597-ff13-4caf-b121-3180dd60dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.064056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91597-ff13-4caf-b121-3180dd60dadf admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.065164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91597-ff13-4caf-b121-3180dd60dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.065450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d91597-ff13-4caf-b121-3180dd60dadf admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.066194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d91597-ff13-4caf-b121-3180dd60dadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.067817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d91597-ff13-4caf-b121-3180dd60dadf admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.078233 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1269/2585] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:39.083622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.093709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551e9fd-9bf0-42c3-953f-8cdd73773572 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.098549 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.099420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.099709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.100023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] PATH_INFO: `/v3/projects/a0eabd058cc94b59b05b8a00c47fb113/users/c4cf11143cb3455fb2da38831e369651/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.115106 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0eabd058cc94b59b05b8a00c47fb113, user_id=c4cf11143cb3455fb2da38831e369651, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.117776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.131639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1317/2586] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:39 2022] PUT /identity/v3/projects/a0eabd058cc94b59b05b8a00c47fb113/users/c4cf11143cb3455fb2da38831e369651/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:39.141752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.142052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.142399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.169112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] MFA Rules not processed for user `c4cf11143cb3455fb2da38831e369651`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:39.170522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:39.229616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:39.240106 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1270/2587] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:39.241251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.302689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4586e-02a6-4a72-9efd-4c0c46612fdc admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.307344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.308038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.308333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.308615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.309313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.311236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.338745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1318/2588] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:39 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:39.340217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.351886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea32bbd-5dee-48ba-9f66-5a8c3f55a53c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.409244 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.409836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.410120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.410399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.411078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.413024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.433771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1271/2589] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:39 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:39.437676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.448055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676c49e-9a72-4d1e-82ce-f7adbe5a89c4 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.452647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.453305 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.453597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.453882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.454614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.456488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.467065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1319/2590] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:39.471904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.482018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba8b14-5f07-4c40-a506-e4db9cd56fd0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.487732 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.488671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.488961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.489244 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] PATH_INFO: `/v3/projects/70442c057bc64531b3cb0a4c6ce69ba3/users/a33f373c6d054129a55996be29dd6132/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.504097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70442c057bc64531b3cb0a4c6ce69ba3, user_id=a33f373c6d054129a55996be29dd6132, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.506778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.519447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1272/2591] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:39 2022] PUT /identity/v3/projects/70442c057bc64531b3cb0a4c6ce69ba3/users/a33f373c6d054129a55996be29dd6132/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:39.523556 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.534217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed2ea6-f341-4a41-bb3d-ad6782c2432b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.583047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:39.590607 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ea3b-4c3c-42ab-bc22-34eb95b21dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.591457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ea3b-4c3c-42ab-bc22-34eb95b21dde admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.591751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ea3b-4c3c-42ab-bc22-34eb95b21dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.592072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ea3b-4c3c-42ab-bc22-34eb95b21dde admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.592810 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34ea3b-4c3c-42ab-bc22-34eb95b21dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.594410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34ea3b-4c3c-42ab-bc22-34eb95b21dde admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.604874 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1320/2592] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:39.609359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.620625 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34c7f5-65f7-4c27-9241-2a9f5d05d54d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.625288 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.626168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.626468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.626797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] PATH_INFO: `/v3/projects/70442c057bc64531b3cb0a4c6ce69ba3/users/a33f373c6d054129a55996be29dd6132/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.629096 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70442c057bc64531b3cb0a4c6ce69ba3, user_id=a33f373c6d054129a55996be29dd6132, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.631851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.642123 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1273/2593] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:39 2022] PUT /identity/v3/projects/70442c057bc64531b3cb0a4c6ce69ba3/users/a33f373c6d054129a55996be29dd6132/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:39.655424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.655936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.656049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.685597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] MFA Rules not processed for user `a33f373c6d054129a55996be29dd6132`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:39.686948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:39.762938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1321/2594] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:39.774257 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.776074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:39.834620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f780-cf77-4abe-a8b3-8acc601befa8 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.838294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.838937 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.839253 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.839535 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:39.849128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:39.850552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:39.860109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1274/2595] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:39.931160 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:39.941016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f387-84bc-4b22-bef3-5b3d1ca68725 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:39.944592 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2edb-fb46-4bbc-a273-9f84ef9241cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:39.945232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2edb-fb46-4bbc-a273-9f84ef9241cb service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:39.945524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2edb-fb46-4bbc-a273-9f84ef9241cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:39.945809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2edb-fb46-4bbc-a273-9f84ef9241cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:40.002720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2edb-fb46-4bbc-a273-9f84ef9241cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:40.004204 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2edb-fb46-4bbc-a273-9f84ef9241cb service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:40.013049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1322/2596] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:44.046949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:44.100024 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:44.112334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f9644-a0f4-481d-8e9b-c22f5417acdf service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:44.117598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:44.118470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:44.118757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:44.119036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] PATH_INFO: `/v3/users/c4cf11143cb3455fb2da38831e369651` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:44.120246 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cf11143cb3455fb2da38831e369651)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:44.122192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:44.168906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cf11143cb3455fb2da38831e369651'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:44.177838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cf11143cb3455fb2da38831e369651'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:44.186559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cf11143cb3455fb2da38831e369651'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:44.187294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cf11143cb3455fb2da38831e369651'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:44.187932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cf11143cb3455fb2da38831e369651'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:44.209633 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1275/2597] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:44 2022] DELETE /identity/v3/users/c4cf11143cb3455fb2da38831e369651 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:44.214138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:44.214614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:44.214712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:44.231989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:44.233526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:44.294719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1323/2598] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:44.305762 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:44.307283 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:44.368529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10c44a-ba6b-4744-9690-a47f81970807 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:44.372267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:44.372926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:44.373213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:44.373493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:44.383456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:44.384913 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:44.394646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1276/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:45.038131 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:45.039696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:45.052823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae434c-5a26-490e-a279-453765eeb7d7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:45.062020 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:45.063437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:45.063825 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:45.064250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] PATH_INFO: `/v3/projects/a0eabd058cc94b59b05b8a00c47fb113` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:45.066647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0eabd058cc94b59b05b8a00c47fb113)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:45.069961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:45.084543 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=100 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:45.127103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0eabd058cc94b59b05b8a00c47fb113', 'request_id': 'req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.133715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0eabd058cc94b59b05b8a00c47fb113', 'request_id': 'req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.140978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0eabd058cc94b59b05b8a00c47fb113', 'request_id': 'req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.154323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] The token cache is being invalidate because project a0eabd058cc94b59b05b8a00c47fb113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:45.154617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.155236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.156890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1324/2600] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:45 2022] DELETE /identity/v3/projects/a0eabd058cc94b59b05b8a00c47fb113 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:45.161409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:45.175680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc2d7-6542-4a21-be7e-eea270824752 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:45.240957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:45.241875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:45.242987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:45.243281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] PATH_INFO: `/v3/users/a33f373c6d054129a55996be29dd6132` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:45.244777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33f373c6d054129a55996be29dd6132)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:45.246851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:45.267232 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:45.300543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33f373c6d054129a55996be29dd6132'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.308517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33f373c6d054129a55996be29dd6132'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.318486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33f373c6d054129a55996be29dd6132'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.319202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33f373c6d054129a55996be29dd6132'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.319949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-232b32cf-3cda-4c76-a436-dd2a34bb3be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33f373c6d054129a55996be29dd6132'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.339195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1277/2601] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:45 2022] DELETE /identity/v3/users/a33f373c6d054129a55996be29dd6132 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:45.748159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:45.749671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:45.775039 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43cd35-add3-4da0-a2ad-e1a94f19a5fe admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:45.836608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:45.837478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:45.837768 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:45.838052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] PATH_INFO: `/v3/projects/70442c057bc64531b3cb0a4c6ce69ba3` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:45.839240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70442c057bc64531b3cb0a4c6ce69ba3)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:45.841257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:45.889043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70442c057bc64531b3cb0a4c6ce69ba3', 'request_id': 'req-3583015a-3a95-449e-991f-076639b57ba2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.894881 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70442c057bc64531b3cb0a4c6ce69ba3', 'request_id': 'req-3583015a-3a95-449e-991f-076639b57ba2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.901565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70442c057bc64531b3cb0a4c6ce69ba3', 'request_id': 'req-3583015a-3a95-449e-991f-076639b57ba2'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.915158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] The token cache is being invalidate because project 70442c057bc64531b3cb0a4c6ce69ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:45.915453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.916110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-3583015a-3a95-449e-991f-076639b57ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:45.917706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1325/2602] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:45 2022] DELETE /identity/v3/projects/70442c057bc64531b3cb0a4c6ce69ba3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:45.922522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc922d-ca7d-4980-843c-963559d05566 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:45.922829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc922d-ca7d-4980-843c-963559d05566 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:45.923115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc922d-ca7d-4980-843c-963559d05566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:45.941739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-febc922d-ca7d-4980-843c-963559d05566 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:45.943145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-febc922d-ca7d-4980-843c-963559d05566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:46.011726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1278/2603] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:46.019177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.019473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.019755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.037161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.037722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.038078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.040362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:46.041597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:46.050238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1326/2604] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:46.055082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.058164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] MFA Rules not processed for user `568d5348695e4dfeb57350dbc404ec48`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:46.059603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:46.065175 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edfb7b-24d8-4872-9e64-89e9bc2ce1c1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.070799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.071464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.071752 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.072079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.072805 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:46.073116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.074717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.090311 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1327/2605] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:36:46.091814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.102893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093186f-c915-4288-9a79-96daba39d258 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.107996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.108641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.108931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.109217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.109899 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.111802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.117238 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:46.123226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1279/2606] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:36:46.141532 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1328/2607] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:46.145828 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.156721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebc31a-24d9-4ced-9227-08c2ad5e2131 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.196972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:46.218206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.218874 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.219160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.219439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.220168 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.222079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.246860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1280/2608] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:36:46.248176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.259043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc7c2-bb21-49ae-bb5d-77800c9638ca admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.263777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.264545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.264901 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.265254 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.266143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.267723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.280936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1329/2609] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:46.282059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.292548 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db532733-24db-47a4-817a-d68adea112aa admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.297148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640bf0d-c452-447d-92fd-25f36def0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.297806 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640bf0d-c452-447d-92fd-25f36def0b8c admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.298095 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640bf0d-c452-447d-92fd-25f36def0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.298377 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640bf0d-c452-447d-92fd-25f36def0b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.299108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640bf0d-c452-447d-92fd-25f36def0b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.300722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640bf0d-c452-447d-92fd-25f36def0b8c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.311895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1281/2610] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:46.316080 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.326313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a02a-ecdf-44c6-b8e1-0dd09d253c98 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.330924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.331801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.332135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.332419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] PATH_INFO: `/v3/projects/4a7e989371d04f9e90378d1b469e36e3/users/bcc33e607f8e4e138da3985ac3a8f2a9/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.348200 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7e989371d04f9e90378d1b469e36e3, user_id=bcc33e607f8e4e138da3985ac3a8f2a9, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.351578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.365256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1330/2611] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:46 2022] PUT /identity/v3/projects/4a7e989371d04f9e90378d1b469e36e3/users/bcc33e607f8e4e138da3985ac3a8f2a9/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:46.375431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.375774 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.376092 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.404660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] MFA Rules not processed for user `bcc33e607f8e4e138da3985ac3a8f2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:46.406145 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:46.475861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1282/2612] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:46.480462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.545287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61598545-711b-407f-b275-4594b8ab9d1b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.549917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.550584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.550877 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.551162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.552068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.554000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.583122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1331/2613] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:46.584564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.595854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91467692-deff-4b11-ae26-ddccaf66476d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.655154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.655964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.656354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.656736 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.657640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.659654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.685610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1283/2614] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:46.687344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.698904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6fbc1-942a-48c6-9638-ccb7e81f8940 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.704665 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.705721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.706239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.706718 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.707593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.709352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.724143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1332/2615] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:46.726910 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.739635 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45cd50-cae0-480b-821c-1e9f35260a13 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.745316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.746219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.746513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.746797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] PATH_INFO: `/v3/projects/beaf72cb26f040598c38bf408d1fefc9/users/fb7755b69b2b4fc9b666d06905ee4794/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.763750 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaf72cb26f040598c38bf408d1fefc9, user_id=fb7755b69b2b4fc9b666d06905ee4794, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.766652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.781973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1284/2616] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:46 2022] PUT /identity/v3/projects/beaf72cb26f040598c38bf408d1fefc9/users/fb7755b69b2b4fc9b666d06905ee4794/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:36:46.786505 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.801312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a967-4f66-4054-8847-b4aee82697e5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.862458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeaafe-96ff-4daa-b750-0f8eb1820135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.863134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeaafe-96ff-4daa-b750-0f8eb1820135 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.863453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeaafe-96ff-4daa-b750-0f8eb1820135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.863737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeaafe-96ff-4daa-b750-0f8eb1820135 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.865050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeaafe-96ff-4daa-b750-0f8eb1820135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.866790 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeaafe-96ff-4daa-b750-0f8eb1820135 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.880263 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1333/2617] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:46.881428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:46.891703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b2576-b5d0-403b-9b27-e43b66b5210a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:46.896734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:46.897647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.897935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.898337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] PATH_INFO: `/v3/projects/beaf72cb26f040598c38bf408d1fefc9/users/fb7755b69b2b4fc9b666d06905ee4794/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.900441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=beaf72cb26f040598c38bf408d1fefc9, user_id=fb7755b69b2b4fc9b666d06905ee4794, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:46.903070 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:46.909735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:46.915962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1285/2618] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:46 2022] PUT /identity/v3/projects/beaf72cb26f040598c38bf408d1fefc9/users/fb7755b69b2b4fc9b666d06905ee4794/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:46.928196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:46.928560 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:46.928853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:46.957488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] MFA Rules not processed for user `fb7755b69b2b4fc9b666d06905ee4794`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:46.958784 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:46.968836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:47.035349 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1334/2619] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:47.046407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:47.048517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:47.120218 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5098e61-3907-40da-83db-39be5a3e0c7b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:47.123792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db9d16-4289-4302-a2a4-bbd814b68768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:47.124464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db9d16-4289-4302-a2a4-bbd814b68768 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:47.124752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db9d16-4289-4302-a2a4-bbd814b68768 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:47.125027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db9d16-4289-4302-a2a4-bbd814b68768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:47.135455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db9d16-4289-4302-a2a4-bbd814b68768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:47.137144 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db9d16-4289-4302-a2a4-bbd814b68768 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:47.148694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1286/2620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:36:47.283414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:47.352760 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200700e-8c54-4c5f-9805-0797bd662bc0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:47.358303 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:47.359182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:47.359593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:47.359909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] PATH_INFO: `/v3/users/bcc33e607f8e4e138da3985ac3a8f2a9` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:47.361143 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc33e607f8e4e138da3985ac3a8f2a9)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:47.363067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:47.410514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc33e607f8e4e138da3985ac3a8f2a9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:47.418350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc33e607f8e4e138da3985ac3a8f2a9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:47.425453 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc33e607f8e4e138da3985ac3a8f2a9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:47.426097 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc33e607f8e4e138da3985ac3a8f2a9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:47.427292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc33e607f8e4e138da3985ac3a8f2a9'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:47.444457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1335/2621] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:47 2022] DELETE /identity/v3/users/bcc33e607f8e4e138da3985ac3a8f2a9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:47.448988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:47.449455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:47.449553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:47.466977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:47.468225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:47.527946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1287/2622] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:47.538231 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:47.539661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:47.571278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:47.600933 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8bf5-db10-4e38-b3d8-413f3e3649ae admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:47.604699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:47.605281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:47.605567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:47.605846 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:47.615736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:47.617194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:47.626563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1336/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:48.076064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:48.077504 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:48.090305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38139c-0002-42bf-87e8-fd7b11732ba4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:48.095616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:48.096511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:48.096800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:48.097081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] PATH_INFO: `/v3/projects/4a7e989371d04f9e90378d1b469e36e3` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:48.098270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7e989371d04f9e90378d1b469e36e3)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:48.101213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:48.168308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7e989371d04f9e90378d1b469e36e3', 'request_id': 'req-13aad192-a373-4935-9469-11b05eb2c1b5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.174143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7e989371d04f9e90378d1b469e36e3', 'request_id': 'req-13aad192-a373-4935-9469-11b05eb2c1b5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.182482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7e989371d04f9e90378d1b469e36e3', 'request_id': 'req-13aad192-a373-4935-9469-11b05eb2c1b5'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.196052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] The token cache is being invalidate because project 4a7e989371d04f9e90378d1b469e36e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:48.196345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.197098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.199154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1288/2624] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:48 2022] DELETE /identity/v3/projects/4a7e989371d04f9e90378d1b469e36e3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:48.202828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:48.213364 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa70e6a-fcbb-44f8-be21-43826264785b service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:48.270917 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:48.271928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:48.272226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:48.272510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] PATH_INFO: `/v3/users/fb7755b69b2b4fc9b666d06905ee4794` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:48.273730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7755b69b2b4fc9b666d06905ee4794)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:48.275711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:48.322328 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7755b69b2b4fc9b666d06905ee4794'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.328986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7755b69b2b4fc9b666d06905ee4794'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.336681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7755b69b2b4fc9b666d06905ee4794'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.337407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7755b69b2b4fc9b666d06905ee4794'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.338021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-468ef82a-f011-414a-8855-15759adeabab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7755b69b2b4fc9b666d06905ee4794'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.356503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1337/2625] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:48 2022] DELETE /identity/v3/users/fb7755b69b2b4fc9b666d06905ee4794 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:48.651624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:48.653276 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:48.679410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aad192-a373-4935-9469-11b05eb2c1b5 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:48.713264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:48.754581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:48.756485 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:48.756776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:48.757183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] PATH_INFO: `/v3/projects/beaf72cb26f040598c38bf408d1fefc9` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:48.758359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=beaf72cb26f040598c38bf408d1fefc9)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:48.760293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:48.822376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beaf72cb26f040598c38bf408d1fefc9', 'request_id': 'req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.831593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beaf72cb26f040598c38bf408d1fefc9', 'request_id': 'req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.839076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beaf72cb26f040598c38bf408d1fefc9', 'request_id': 'req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.854078 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] The token cache is being invalidate because project beaf72cb26f040598c38bf408d1fefc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:48.854379 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.855017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d0a44ce8-fa99-4a0b-a00d-a1d91cdbb33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:48.856622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1289/2626] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:48 2022] DELETE /identity/v3/projects/beaf72cb26f040598c38bf408d1fefc9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:48.861772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:48.862142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:48.862488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:48.882294 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:48.883522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:48.932450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:48.952491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1338/2627] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:48.960214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:48.961135 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:48.961457 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:48.980990 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:48.982222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:49.004074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1290/2628] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:49.005819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.015749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180a07b-0e01-4094-8c6f-6d7e91bf833d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.020822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.021585 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.021876 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.022161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.022889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:36:49.023201 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.024895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.040961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1339/2629] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:36:49.042130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.058809 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f090db9-e1ef-4082-aef7-daa8c8fc07a0 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.063518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.064227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.064512 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.064790 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.065482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.068041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.098105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1291/2630] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:36:49 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:49.107452 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.120516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdbbf8-d360-4077-855e-1376841907d8 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.233224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.233924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.234222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.234512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.235832 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.237849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.261972 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1340/2631] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:36:49 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:36:49.266292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.278473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb66cd-87fd-43a1-9419-18e23244c799 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.283342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.284082 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.284381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.284665 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.285447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.287159 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.306006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1292/2632] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:49.310315 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.321708 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb43ccb-780a-422f-915f-07b8b21ed05c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.326446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc91b0-3a19-49a0-8981-1b7ed1ea4b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.327113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc91b0-3a19-49a0-8981-1b7ed1ea4b22 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.327441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc91b0-3a19-49a0-8981-1b7ed1ea4b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.327750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc91b0-3a19-49a0-8981-1b7ed1ea4b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.328616 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc91b0-3a19-49a0-8981-1b7ed1ea4b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.330389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc91b0-3a19-49a0-8981-1b7ed1ea4b22 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.343136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1341/2633] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:36:49.347207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.357882 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63de098-32ab-4e24-939d-a6fa84be5741 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.362738 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.363640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.363951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.364306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] PATH_INFO: `/v3/projects/42ee305b3bd149f3bb9fbd5ea877548d/users/af108fa5e32b4c6a907d43005af96bda/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.397908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ee305b3bd149f3bb9fbd5ea877548d, user_id=af108fa5e32b4c6a907d43005af96bda, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.406125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.424763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1293/2634] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:36:49 2022] PUT /identity/v3/projects/42ee305b3bd149f3bb9fbd5ea877548d/users/af108fa5e32b4c6a907d43005af96bda/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:49.429994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941183df-7140-435c-b6d6-56a767ee6ad8 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.430297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941183df-7140-435c-b6d6-56a767ee6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.430584 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941183df-7140-435c-b6d6-56a767ee6ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.450719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-941183df-7140-435c-b6d6-56a767ee6ad8 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:49.451981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-941183df-7140-435c-b6d6-56a767ee6ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:49.530193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1342/2635] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:49.540810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:49.542771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:49.606206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c589a-737a-440f-ae5f-712ac8a185c2 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:49.610178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:49.610833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:49.611125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:49.611409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:49.620214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:49.622576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:49.624458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:49.636211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1294/2636] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:50.259397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744dea5-8660-4f96-aa33-534b54f0f4a7 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:50.260437 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744dea5-8660-4f96-aa33-534b54f0f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:50.260753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744dea5-8660-4f96-aa33-534b54f0f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:50.292730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3744dea5-8660-4f96-aa33-534b54f0f4a7 None None] MFA Rules not processed for user `af108fa5e32b4c6a907d43005af96bda`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:50.294192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3744dea5-8660-4f96-aa33-534b54f0f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:50.359003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:50.386545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1343/2637] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:50.402754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:50.404207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:50.464121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11c39-71d9-4e8f-b2d2-1151aac3eddd service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:50.467669 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:50.468338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:50.468624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:50.468899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:50.477278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:50.478689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:50.487651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1295/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:51.879823 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34efc-b78f-4687-a0b6-cc709d9f7a66 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:51.881008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34efc-b78f-4687-a0b6-cc709d9f7a66 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:51.881138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee34efc-b78f-4687-a0b6-cc709d9f7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:51.900384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-aee34efc-b78f-4687-a0b6-cc709d9f7a66 None None] MFA Rules not processed for user `af108fa5e32b4c6a907d43005af96bda`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:51.901606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-aee34efc-b78f-4687-a0b6-cc709d9f7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:51.909286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1344/2639] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:36:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:00.483629 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=28 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:01.893745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=10 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:07.257776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:07.259209 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:07.271236 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40b5e-f208-4661-a9a8-cc6b40a3d1b3 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:07.275317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:07.275974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:07.276267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:07.276543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:07.278384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:07.291019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:07.292474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:07.302169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1296/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:09.656490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.657027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.657137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.680491 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] MFA Rules not processed for user `af108fa5e32b4c6a907d43005af96bda`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:09.680715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:09.688651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1345/2641] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:11.231351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:11.233138 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:11.245969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7e4c-77e5-48ca-89cd-182877fba987 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:11.250572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:11.251438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:11.251723 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:11.252040 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] PATH_INFO: `/v3/users/23f4bd4c685d489dbcec17b69656044e` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:11.253206 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f4bd4c685d489dbcec17b69656044e)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:11.255107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:11.302931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f4bd4c685d489dbcec17b69656044e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.311944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f4bd4c685d489dbcec17b69656044e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.319255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f4bd4c685d489dbcec17b69656044e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.319961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f4bd4c685d489dbcec17b69656044e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.320573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-e42ee6d3-26d4-463d-8cbb-fae7cc88063d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f4bd4c685d489dbcec17b69656044e'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.338305 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1297/2642] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:11 2022] DELETE /identity/v3/users/23f4bd4c685d489dbcec17b69656044e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:11.520435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:11.533046 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50526591-7c2b-4c53-be2f-a5d44a164822 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:11.620705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:11.621969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:11.622449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:11.622905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] PATH_INFO: `/v3/projects/9d7a93a65dcf42cb83ce6d5a4233bd4c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:11.624420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7a93a65dcf42cb83ce6d5a4233bd4c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:11.626597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:11.694205 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7a93a65dcf42cb83ce6d5a4233bd4c', 'request_id': 'req-b465a24d-7ce0-486b-9688-0b2aa02954d4'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.700575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7a93a65dcf42cb83ce6d5a4233bd4c', 'request_id': 'req-b465a24d-7ce0-486b-9688-0b2aa02954d4'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.708092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7a93a65dcf42cb83ce6d5a4233bd4c', 'request_id': 'req-b465a24d-7ce0-486b-9688-0b2aa02954d4'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.722912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] The token cache is being invalidate because project 9d7a93a65dcf42cb83ce6d5a4233bd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:11.723270 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.724007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b465a24d-7ce0-486b-9688-0b2aa02954d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:11.726670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1346/2643] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:11 2022] DELETE /identity/v3/projects/9d7a93a65dcf42cb83ce6d5a4233bd4c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:11.731805 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:11.732491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:11.733158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:11.751325 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:11.752575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:11.813055 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1298/2644] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:11.821558 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:11.821879 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:11.822163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:11.841082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:11.842210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:11.850730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1347/2645] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:11.856254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:11.867295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e470654-ce29-4560-bfe4-002e2a7f6500 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:11.871961 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:11.872572 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:11.872862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:11.873148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:11.873880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:11.874196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:11.875799 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:11.892119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1299/2646] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:11.898365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:11.909686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5e15-b1c1-46e6-bf13-ae6931310517 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:11.914971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:11.915636 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:11.915951 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:11.916234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:11.916935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:11.918847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:11.949007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1348/2647] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:11 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:11.950912 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:11.962573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8114a-3e82-42b0-9a26-32b2ac432b6e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.011214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:12.026914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.027620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.027967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.028261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.028956 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.030881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.056946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1300/2648] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:11 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:12.060785 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.072559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80bb2-8a1c-4bdb-afde-ad63decbfffb admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.077395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.078071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.078366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.078654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.079396 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.081069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.092499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1349/2649] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:12.096487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.107012 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43e4a7-236c-48e8-8ec4-f3198ca9ee2c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.112767 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0da2fd-a618-4442-ad31-f5a2463aa9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.113433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0da2fd-a618-4442-ad31-f5a2463aa9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.113727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0da2fd-a618-4442-ad31-f5a2463aa9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.114018 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0da2fd-a618-4442-ad31-f5a2463aa9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.114763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0da2fd-a618-4442-ad31-f5a2463aa9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.117027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0da2fd-a618-4442-ad31-f5a2463aa9e9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.127460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1301/2650] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:12.132914 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.143164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69fa4d-fafc-42ae-8395-fdbeebf4e0da admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.148362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.149331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.149716 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.150101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] PATH_INFO: `/v3/projects/83ae9ef3b81b4838a5aa10a7fed478bb/users/29f4f1162d8143edae2ee8c186150c9a/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.167535 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ae9ef3b81b4838a5aa10a7fed478bb, user_id=29f4f1162d8143edae2ee8c186150c9a, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.170282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.184431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1350/2651] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:12 2022] PUT /identity/v3/projects/83ae9ef3b81b4838a5aa10a7fed478bb/users/29f4f1162d8143edae2ee8c186150c9a/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:12.196255 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.196650 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.197005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.226772 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] MFA Rules not processed for user `29f4f1162d8143edae2ee8c186150c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:12.228069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:12.296175 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1302/2652] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:12.300691 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.322835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:12.366969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c67424-c27b-4a24-b961-6b92818b84a0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.371489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.372176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.372459 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.372736 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.373457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.375342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.401748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1351/2653] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:12 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:12.405795 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.416517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14c46e-0f55-4ca9-b0a4-bf7192d61317 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.475214 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.475857 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.476178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.476464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.477172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.479132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.503385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1303/2654] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:12 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:12.505576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.516159 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edb950-857a-4607-812f-24357b901eb2 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.521047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.521647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.521974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.522214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.522993 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.524641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.539386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1352/2655] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:12.540908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.551158 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2131f2-9307-4969-a683-1655d727e727 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.556470 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.557349 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.557641 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.557923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] PATH_INFO: `/v3/projects/da9f5df7bb624fa3b1f40cc6c3eab7df/users/b2aefc6385c0408bbc29272c750b9bc2/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.572989 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f5df7bb624fa3b1f40cc6c3eab7df, user_id=b2aefc6385c0408bbc29272c750b9bc2, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.575692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.590079 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1304/2656] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:12 2022] PUT /identity/v3/projects/da9f5df7bb624fa3b1f40cc6c3eab7df/users/b2aefc6385c0408bbc29272c750b9bc2/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:12.593915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.604618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b0fea-5f75-4581-93d4-be960b0ca50d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.664938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674655a-e62e-4779-863a-189cbd411d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.665628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674655a-e62e-4779-863a-189cbd411d87 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.665918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674655a-e62e-4779-863a-189cbd411d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.666199 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674655a-e62e-4779-863a-189cbd411d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.666940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674655a-e62e-4779-863a-189cbd411d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.668750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674655a-e62e-4779-863a-189cbd411d87 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.683550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1353/2657] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:12.685322 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.698054 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120758b9-70f6-463d-ac07-b683f15daee6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.704619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.706174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.707918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.707918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] PATH_INFO: `/v3/projects/da9f5df7bb624fa3b1f40cc6c3eab7df/users/b2aefc6385c0408bbc29272c750b9bc2/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.710261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9f5df7bb624fa3b1f40cc6c3eab7df, user_id=b2aefc6385c0408bbc29272c750b9bc2, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.714724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.730817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1305/2658] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:12 2022] PUT /identity/v3/projects/da9f5df7bb624fa3b1f40cc6c3eab7df/users/b2aefc6385c0408bbc29272c750b9bc2/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:12.742727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.743041 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.743299 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.772610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] MFA Rules not processed for user `b2aefc6385c0408bbc29272c750b9bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:12.774012 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:12.859502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1354/2659] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:12.872927 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:12.875482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:12.889068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:12.956350 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77b84-f002-40e9-982a-514feb3913b4 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:12.962385 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:12.963050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:12.963339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:12.963620 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:12.974073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:12.976418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:12.987342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1306/2660] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:13.042062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:13.044216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:13.059606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5c427-e791-48ab-87fe-c28521d4387b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:13.063930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859cce-42dd-4df2-8f30-a649869ac3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:13.065228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859cce-42dd-4df2-8f30-a649869ac3ab service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:13.065935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859cce-42dd-4df2-8f30-a649869ac3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:13.066637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859cce-42dd-4df2-8f30-a649869ac3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:13.083342 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:13.172279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859cce-42dd-4df2-8f30-a649869ac3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:13.174646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859cce-42dd-4df2-8f30-a649869ac3ab service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:13.186477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1355/2661] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:16.535057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:16.596628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67a75-b818-4687-99ab-2639233b7abe service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:16.601981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:16.602838 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:16.603121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:16.603513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] PATH_INFO: `/v3/users/29f4f1162d8143edae2ee8c186150c9a` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:16.604715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f4f1162d8143edae2ee8c186150c9a)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:16.606613 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:16.653348 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f4f1162d8143edae2ee8c186150c9a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:16.661154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f4f1162d8143edae2ee8c186150c9a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:16.668675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f4f1162d8143edae2ee8c186150c9a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:16.669332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f4f1162d8143edae2ee8c186150c9a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:16.669945 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f4f1162d8143edae2ee8c186150c9a'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:16.686985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1307/2662] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:16 2022] DELETE /identity/v3/users/29f4f1162d8143edae2ee8c186150c9a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:16.691408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:16.691866 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:16.692003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:16.708568 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:16.710301 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:16.768001 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1356/2663] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:16.778438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:16.779852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:16.812119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:16.840558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec14ef-9768-49ce-8e13-ea89f0360733 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:16.844172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:16.844812 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:16.845102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:16.845381 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:16.854917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:16.856372 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:16.866093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1308/2664] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:17.131948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:17.133383 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:17.145730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eb49f-0faf-4b18-9e4e-7ba398665832 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:17.151504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:17.152527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.152821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.153416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] PATH_INFO: `/v3/projects/83ae9ef3b81b4838a5aa10a7fed478bb` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.154319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ae9ef3b81b4838a5aa10a7fed478bb)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:17.156293 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:17.206955 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ae9ef3b81b4838a5aa10a7fed478bb', 'request_id': 'req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.213595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ae9ef3b81b4838a5aa10a7fed478bb', 'request_id': 'req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.219646 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ae9ef3b81b4838a5aa10a7fed478bb', 'request_id': 'req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.233346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] The token cache is being invalidate because project 83ae9ef3b81b4838a5aa10a7fed478bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:17.233655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.234291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.238740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1357/2665] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:17 2022] DELETE /identity/v3/projects/83ae9ef3b81b4838a5aa10a7fed478bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:17.240026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:17.249584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede1ba2-360e-4ea7-afbe-7ac1ca3bdbc6 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:17.310992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:17.311901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.312196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.312480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] PATH_INFO: `/v3/users/b2aefc6385c0408bbc29272c750b9bc2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.313696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2aefc6385c0408bbc29272c750b9bc2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:17.315630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:17.364680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2aefc6385c0408bbc29272c750b9bc2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.372832 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2aefc6385c0408bbc29272c750b9bc2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.379807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2aefc6385c0408bbc29272c750b9bc2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.380516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2aefc6385c0408bbc29272c750b9bc2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.381692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-6f215958-28fa-4c56-9f6e-e0a267694a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2aefc6385c0408bbc29272c750b9bc2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.399451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1309/2666] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:17 2022] DELETE /identity/v3/users/b2aefc6385c0408bbc29272c750b9bc2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:17.682905 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:17.684384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:17.697925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373aa3f-14dc-42a4-ab7f-2c0fd1179317 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:17.734314 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:17.758662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:17.759527 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.759861 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.760166 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] PATH_INFO: `/v3/projects/da9f5df7bb624fa3b1f40cc6c3eab7df` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.761375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9f5df7bb624fa3b1f40cc6c3eab7df)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:17.763431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:17.809739 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9f5df7bb624fa3b1f40cc6c3eab7df', 'request_id': 'req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.815214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9f5df7bb624fa3b1f40cc6c3eab7df', 'request_id': 'req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.822079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9f5df7bb624fa3b1f40cc6c3eab7df', 'request_id': 'req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.837095 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] The token cache is being invalidate because project da9f5df7bb624fa3b1f40cc6c3eab7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:17.837655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.838289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-40edf0b8-2b2a-4a7a-b813-c60f4d522b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:17.839849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1358/2667] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:17 2022] DELETE /identity/v3/projects/da9f5df7bb624fa3b1f40cc6c3eab7df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:17.844761 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.845237 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.845454 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.864064 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:17.865278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:17.918207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:17.934662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1310/2668] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:17.944703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.944703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.945068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.963575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:17.964845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:17.972717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1359/2669] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:17.976891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:17.986777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed785-2804-4b06-94df-f9a319aeb461 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:17.991306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:17.991980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.992269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.992547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.993384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:17.993693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:17.995282 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.007022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1311/2670] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:18.011045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.020180 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acdd33-d614-435e-8f95-7f43e50bb661 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.025632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.026281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.026569 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.026851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.027539 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.029464 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.058011 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1360/2671] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:18 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:18.058978 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.069551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e14c0-2171-4e0f-aa63-20f85d709a41 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.124988 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.125646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.125933 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.126213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.126902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.128847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.148597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1312/2672] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:18 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:18.152789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.163193 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad897bbb-66f4-45b9-a50f-19f0fefac41d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.167853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.168545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.168840 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.169130 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.169904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.171509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.182777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1361/2673] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:18.186729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.197459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfae8-db02-4ed0-ad61-a3865fbe53fb admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.202091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e56c3d-245f-4193-b6dd-cfe28f51ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.202773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e56c3d-245f-4193-b6dd-cfe28f51ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.203068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e56c3d-245f-4193-b6dd-cfe28f51ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.203353 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e56c3d-245f-4193-b6dd-cfe28f51ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.204119 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e56c3d-245f-4193-b6dd-cfe28f51ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.205707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e56c3d-245f-4193-b6dd-cfe28f51ee6e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.215755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1313/2674] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:18.219709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.229724 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31e202-4fe0-4e22-a96a-021d95e9b709 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.234523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.235750 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.236176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.236526 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] PATH_INFO: `/v3/projects/7991c1b311d046699b31f65c0ea8ec4b/users/4f479f4a94d143b78d67e20ce88006be/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.251499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7991c1b311d046699b31f65c0ea8ec4b, user_id=4f479f4a94d143b78d67e20ce88006be, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.254162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.267967 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1362/2675] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:18 2022] PUT /identity/v3/projects/7991c1b311d046699b31f65c0ea8ec4b/users/4f479f4a94d143b78d67e20ce88006be/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:18.278110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.278408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.278692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.304770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] MFA Rules not processed for user `4f479f4a94d143b78d67e20ce88006be`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:18.305997 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:18.369953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1314/2676] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:18.374329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.435076 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cfd7-0906-43d3-a166-5d14a5ec40d9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.439638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.440318 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.440608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.440889 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.441575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.444045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.451855 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:18.470462 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1363/2677] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:18 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:18.474433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.485408 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfe2c2-e906-46b9-874c-0180b5ea2ae6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.529464 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:18.543965 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.544642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.544935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.545220 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.545914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.547840 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.570998 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1315/2678] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:18 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:18.572395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.582762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2020f8-4803-4f9a-b33a-20ed0f50a6af admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.587799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.588493 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.588786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.589072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.589809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.591411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.603851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1364/2679] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:18.608284 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.619172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f4f07-57d9-4dfa-a113-aafeb3849eef admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.623824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.624764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.625052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.625333 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] PATH_INFO: `/v3/projects/3cf7789887364d9899fa45e4222322d8/users/8a0bdffa034745ad81b7c2623eac1ed8/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.641831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7789887364d9899fa45e4222322d8, user_id=8a0bdffa034745ad81b7c2623eac1ed8, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.644524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.657921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1316/2680] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:18 2022] PUT /identity/v3/projects/3cf7789887364d9899fa45e4222322d8/users/8a0bdffa034745ad81b7c2623eac1ed8/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:18.661990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.672668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60e6d-c101-4fd1-b233-7cc7a7279ad5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.733405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689193e1-b2ba-4f88-a302-d61d892dddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.734105 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689193e1-b2ba-4f88-a302-d61d892dddea admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.734401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689193e1-b2ba-4f88-a302-d61d892dddea admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.734689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689193e1-b2ba-4f88-a302-d61d892dddea admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.735433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689193e1-b2ba-4f88-a302-d61d892dddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.737088 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689193e1-b2ba-4f88-a302-d61d892dddea admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.748394 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1365/2681] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:18.752221 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.763121 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9919725-25bc-4cc6-8d03-d5f97ed03693 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.767860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.768777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.769065 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.769341 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] PATH_INFO: `/v3/projects/3cf7789887364d9899fa45e4222322d8/users/8a0bdffa034745ad81b7c2623eac1ed8/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.771297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7789887364d9899fa45e4222322d8, user_id=8a0bdffa034745ad81b7c2623eac1ed8, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.774118 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.784580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1317/2682] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:18 2022] PUT /identity/v3/projects/3cf7789887364d9899fa45e4222322d8/users/8a0bdffa034745ad81b7c2623eac1ed8/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:18.795414 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.795712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.796030 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.822124 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] MFA Rules not processed for user `8a0bdffa034745ad81b7c2623eac1ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:18.823337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:18.889867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1366/2683] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:18.901628 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:18.903407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:18.960923 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfc95-74ad-4034-8156-a0e3d7f4eb2b admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:18.964592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd9c0-587a-44ea-871e-890d85f32ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:18.965234 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd9c0-587a-44ea-871e-890d85f32ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:18.965525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd9c0-587a-44ea-871e-890d85f32ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:18.965810 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd9c0-587a-44ea-871e-890d85f32ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:18.975442 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd9c0-587a-44ea-871e-890d85f32ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:18.977023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd9c0-587a-44ea-871e-890d85f32ac0 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:18.986687 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1318/2684] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:19.050940 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:19.113329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8cdb-dbb1-4dbf-a978-94e3c48968e0 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:19.117944 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:19.118807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:19.119094 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:19.119370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] PATH_INFO: `/v3/users/4f479f4a94d143b78d67e20ce88006be` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:19.120583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f479f4a94d143b78d67e20ce88006be)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:19.122496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:19.123978 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:19.170122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f479f4a94d143b78d67e20ce88006be'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.177475 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f479f4a94d143b78d67e20ce88006be'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.185223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f479f4a94d143b78d67e20ce88006be'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.186078 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f479f4a94d143b78d67e20ce88006be'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.187000 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f479f4a94d143b78d67e20ce88006be'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.206119 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1367/2685] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:19 2022] DELETE /identity/v3/users/4f479f4a94d143b78d67e20ce88006be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:19.211190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:19.211486 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:19.211768 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:19.230136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:19.231337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:19.292592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1319/2686] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:19.302991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:19.304207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:19.369950 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6dc87-ebbe-4395-8be5-30e82fbc6cf7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:19.373624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:19.374279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:19.374582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:19.374865 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:19.385068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:19.386661 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:19.398048 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1368/2687] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:19.699525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:19.701020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:19.713204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf518e7e-b7a7-4775-9b59-fc3ace629430 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:19.717946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:19.718813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:19.719105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:19.719399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] PATH_INFO: `/v3/projects/7991c1b311d046699b31f65c0ea8ec4b` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:19.720601 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7991c1b311d046699b31f65c0ea8ec4b)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:19.722513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:19.776310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:19.787033 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7991c1b311d046699b31f65c0ea8ec4b', 'request_id': 'req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.793269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7991c1b311d046699b31f65c0ea8ec4b', 'request_id': 'req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.799854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7991c1b311d046699b31f65c0ea8ec4b', 'request_id': 'req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.817759 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] The token cache is being invalidate because project 7991c1b311d046699b31f65c0ea8ec4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:19.818056 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.819354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.820935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1320/2688] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:19 2022] DELETE /identity/v3/projects/7991c1b311d046699b31f65c0ea8ec4b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:19.824863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:19.834740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f53f-8d20-45f7-8de4-f80e269acb3f service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:19.897844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:19.898733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:19.899024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:19.899307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] PATH_INFO: `/v3/users/8a0bdffa034745ad81b7c2623eac1ed8` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:19.900523 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0bdffa034745ad81b7c2623eac1ed8)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:19.902455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:19.927653 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:19.954843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0bdffa034745ad81b7c2623eac1ed8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.961797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0bdffa034745ad81b7c2623eac1ed8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.968806 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0bdffa034745ad81b7c2623eac1ed8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.969425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0bdffa034745ad81b7c2623eac1ed8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.970024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-a677da07-a031-45cf-a518-b360860b4774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0bdffa034745ad81b7c2623eac1ed8'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:19.987816 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1369/2689] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:19 2022] DELETE /identity/v3/users/8a0bdffa034745ad81b7c2623eac1ed8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:20.260133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.261719 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:20.277112 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93aa7-9ddc-4035-aa67-73bcf8d3a6ac admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.335600 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.336433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.336724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.337006 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] PATH_INFO: `/v3/projects/3cf7789887364d9899fa45e4222322d8` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.338202 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf7789887364d9899fa45e4222322d8)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.340172 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.387278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf7789887364d9899fa45e4222322d8', 'request_id': 'req-8d5f751f-7bc7-4624-9847-6a9f128978d0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:20.392769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf7789887364d9899fa45e4222322d8', 'request_id': 'req-8d5f751f-7bc7-4624-9847-6a9f128978d0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:20.399557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf7789887364d9899fa45e4222322d8', 'request_id': 'req-8d5f751f-7bc7-4624-9847-6a9f128978d0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:20.411836 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] The token cache is being invalidate because project 3cf7789887364d9899fa45e4222322d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:20.412155 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:20.413418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8d5f751f-7bc7-4624-9847-6a9f128978d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:20.414968 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1321/2690] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:20 2022] DELETE /identity/v3/projects/3cf7789887364d9899fa45e4222322d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:20.419893 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.420289 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.420648 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.440710 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:20.442007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:20.512281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1370/2691] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:20.520833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.521134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.521426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.540986 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:20.542201 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:20.550059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1322/2692] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:20.554282 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.564240 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc8682-6b9c-4314-aec5-d689fe2a8670 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.568851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.569504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.569826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.570113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.570873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:20.571189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.572875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.585156 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1371/2693] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:20.589424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.598476 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6ce0a-2296-446b-8268-b6135cd33adf None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.603867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.604543 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.604829 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.605109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.605802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.607696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.632731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1323/2694] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:20 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:20.636791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.647346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7e150-a0b1-4e23-97d0-ac0339261b71 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.702446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.703117 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.703411 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.703697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.704430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.706449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.727007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1372/2695] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:20 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:20.731239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.742120 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8f58-f75e-4015-ae65-e2127b6cdb34 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.746727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.747380 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.747699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.748009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.749047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.750624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.761499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1324/2696] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:20.765325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.776363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855a35-59ac-4943-90c3-d2c103b4e512 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.781139 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d964be-269d-4b74-9eb8-520e44722909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.781803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d964be-269d-4b74-9eb8-520e44722909 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.782096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d964be-269d-4b74-9eb8-520e44722909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.782380 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d964be-269d-4b74-9eb8-520e44722909 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.783135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d964be-269d-4b74-9eb8-520e44722909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.784769 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d964be-269d-4b74-9eb8-520e44722909 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.797007 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1373/2697] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:20.801059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:20.811208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9126ee-498e-4323-89a1-0e5c65146799 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:20.815771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:20.816675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.816962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.817242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] PATH_INFO: `/v3/projects/944bdff93bf14f9d815a9d8f4ad7cd51/users/7ec05ecf83c749a9aed6ffb83a6ed137/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.829991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:20.833954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=944bdff93bf14f9d815a9d8f4ad7cd51, user_id=7ec05ecf83c749a9aed6ffb83a6ed137, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:20.838088 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:20.852330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1325/2698] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:20 2022] PUT /identity/v3/projects/944bdff93bf14f9d815a9d8f4ad7cd51/users/7ec05ecf83c749a9aed6ffb83a6ed137/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:20.862900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:20.863412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:20.863604 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:20.875802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:20.891789 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] MFA Rules not processed for user `7ec05ecf83c749a9aed6ffb83a6ed137`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:20.893057 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:20.958412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1374/2699] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:20.963396 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.030140 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3aa34-dd81-4197-ab41-c80288e43f2c admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.034797 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.035460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.035748 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.036059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.036764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.038729 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.071909 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1326/2700] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:20 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:21.073638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.085167 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998ac06-820f-468c-aeec-e71b2eaf724a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.142670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.143341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.143632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.143947 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.144633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.146588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.166069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1375/2701] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:21 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:21.170004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.181025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdb957-57e2-4cbd-be6d-f7299ce31065 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.185680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.186342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.186640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.186932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.187667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.189399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.200642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1327/2702] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:21.204767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.215055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47155a8-f27b-4b97-bd25-a92b4268a68a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.220023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.220973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.221260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.221540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] PATH_INFO: `/v3/projects/12491c74d9244fd98a1a9d934807af31/users/b30d10d51f2f4ebdbeb8a9fc8546bc00/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.237234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12491c74d9244fd98a1a9d934807af31, user_id=b30d10d51f2f4ebdbeb8a9fc8546bc00, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.239953 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.253099 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1376/2703] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:21 2022] PUT /identity/v3/projects/12491c74d9244fd98a1a9d934807af31/users/b30d10d51f2f4ebdbeb8a9fc8546bc00/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:21.257618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.267517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7948e9-9c3c-4be7-be8f-4c990bfbccfd admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.326424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413646a-9910-4451-bd36-53b2f0026208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.327239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413646a-9910-4451-bd36-53b2f0026208 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.327536 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413646a-9910-4451-bd36-53b2f0026208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.327820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413646a-9910-4451-bd36-53b2f0026208 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.328576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413646a-9910-4451-bd36-53b2f0026208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.330351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413646a-9910-4451-bd36-53b2f0026208 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.340981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1328/2704] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:21.345113 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.355853 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d44f9-8d05-4ad8-940d-3bc0ea989a6d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.360882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.361773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.362065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.362352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] PATH_INFO: `/v3/projects/12491c74d9244fd98a1a9d934807af31/users/b30d10d51f2f4ebdbeb8a9fc8546bc00/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.364355 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12491c74d9244fd98a1a9d934807af31, user_id=b30d10d51f2f4ebdbeb8a9fc8546bc00, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.367820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.378791 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1377/2705] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:21 2022] PUT /identity/v3/projects/12491c74d9244fd98a1a9d934807af31/users/b30d10d51f2f4ebdbeb8a9fc8546bc00/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:21.390606 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.390901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.391189 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.420307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] MFA Rules not processed for user `b30d10d51f2f4ebdbeb8a9fc8546bc00`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:21.421519 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:21.473766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:21.496131 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1329/2706] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:21.508695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.510456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:21.562812 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:21.566599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15383-dca7-44ec-bc05-2a77c131c2e7 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.571224 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.571897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.572192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.572478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.581754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.583186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.592571 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1378/2707] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:21.887917 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.898724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0c29c-3d50-4198-90de-1e38578bf636 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.903307 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b30d10d51f2f4ebdbeb8a9fc8546bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12491c74d9244fd98a1a9d934807af31', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.904047 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.904406 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.904720 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.905560 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:21.905870 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.907624 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.921009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1330/2708] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:21.925129 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.934923 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa464-1cdc-4d6e-9c5e-eb6325343c89 service cinder] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:21.939654 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b30d10d51f2f4ebdbeb8a9fc8546bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12491c74d9244fd98a1a9d934807af31', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:21.940326 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:21.940622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:21.940903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:21.941602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:21.943548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:21.969533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1379/2709] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:21 2022] POST /identity/v3/projects => generated 352 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:21.973556 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:21.984888 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72e71-b825-4292-93ae-88d0daa539b3 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:22.040557 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b30d10d51f2f4ebdbeb8a9fc8546bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12491c74d9244fd98a1a9d934807af31', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:22.041503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:22.041954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:22.042297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:22.043167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:22.043540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:22.045376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:22.057756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1331/2710] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:22.095667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:22.106813 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e68310-4e4c-4a53-ac51-008a31e03174 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:22.111647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b30d10d51f2f4ebdbeb8a9fc8546bc00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12491c74d9244fd98a1a9d934807af31', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:22.112533 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:22.112826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:22.113108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] PATH_INFO: `/v3/projects/a5904d7752da47559189f6bb8643eb68` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:22.114316 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a5904d7752da47559189f6bb8643eb68)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:22.116381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:22.164916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5904d7752da47559189f6bb8643eb68', 'request_id': 'req-64aa0980-04f6-4772-b54f-54b1ccd754b0'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.170425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5904d7752da47559189f6bb8643eb68', 'request_id': 'req-64aa0980-04f6-4772-b54f-54b1ccd754b0'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.176575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5904d7752da47559189f6bb8643eb68', 'request_id': 'req-64aa0980-04f6-4772-b54f-54b1ccd754b0'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.191128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] The token cache is being invalidate because project a5904d7752da47559189f6bb8643eb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:22.191423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.192103 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-64aa0980-04f6-4772-b54f-54b1ccd754b0 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.194410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1380/2711] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:22 2022] DELETE /identity/v3/projects/a5904d7752da47559189f6bb8643eb68 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:22.394562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:22.396424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:22.462974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539253d4-24e7-43ae-bc7f-4c7aa33b74e2 tempest-VolumeQuotaClassesTest-507889993 tempest-VolumeQuotaClassesTest-507889993-project-admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:22.524987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:22.525865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:22.526149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:22.526425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] PATH_INFO: `/v3/users/7ec05ecf83c749a9aed6ffb83a6ed137` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:22.527616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec05ecf83c749a9aed6ffb83a6ed137)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:22.529701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:22.547364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:22.583310 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec05ecf83c749a9aed6ffb83a6ed137'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.592052 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec05ecf83c749a9aed6ffb83a6ed137'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.600042 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec05ecf83c749a9aed6ffb83a6ed137'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.600825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec05ecf83c749a9aed6ffb83a6ed137'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.601727 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec05ecf83c749a9aed6ffb83a6ed137'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:22.621048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1332/2712] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:22 2022] DELETE /identity/v3/users/7ec05ecf83c749a9aed6ffb83a6ed137 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:22.625546 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:22.625867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:22.626161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:22.644617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:22.645761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:22.706163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1381/2713] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:22.715904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:22.717402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:22.778230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343982-2627-42ca-aeb8-3b918ff1539e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:22.783076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:22.784137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:22.784440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:22.784743 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:22.795374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:22.796842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:22.807308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1333/2714] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:23.128987 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:23.130450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:23.144601 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f12b2-d1fd-4ae3-b929-bdc142fde840 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:23.149828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:23.150954 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.151146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.151423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] PATH_INFO: `/v3/projects/944bdff93bf14f9d815a9d8f4ad7cd51` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.152754 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944bdff93bf14f9d815a9d8f4ad7cd51)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:23.154702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:23.200502 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:23.201803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944bdff93bf14f9d815a9d8f4ad7cd51', 'request_id': 'req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.208834 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944bdff93bf14f9d815a9d8f4ad7cd51', 'request_id': 'req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.215622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944bdff93bf14f9d815a9d8f4ad7cd51', 'request_id': 'req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.228157 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] The token cache is being invalidate because project 944bdff93bf14f9d815a9d8f4ad7cd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:23.228446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.229063 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.230615 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1382/2715] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:23 2022] DELETE /identity/v3/projects/944bdff93bf14f9d815a9d8f4ad7cd51 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:23.235051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:23.245617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0345a-8788-4800-a6a2-ea0fd95f6749 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:23.300483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:23.301344 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.301627 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.301906 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] PATH_INFO: `/v3/users/b30d10d51f2f4ebdbeb8a9fc8546bc00` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.303682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30d10d51f2f4ebdbeb8a9fc8546bc00)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:23.305618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:23.348050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:23.355452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30d10d51f2f4ebdbeb8a9fc8546bc00'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.363141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30d10d51f2f4ebdbeb8a9fc8546bc00'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.370899 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30d10d51f2f4ebdbeb8a9fc8546bc00'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.371528 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30d10d51f2f4ebdbeb8a9fc8546bc00'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.372171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-4a761286-8be6-415a-90d0-86092c65c223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30d10d51f2f4ebdbeb8a9fc8546bc00'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.389497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1334/2716] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:23 2022] DELETE /identity/v3/users/b30d10d51f2f4ebdbeb8a9fc8546bc00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:23.658719 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:23.660608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:23.677873 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2dcb0-4bc3-45b0-bd24-cb718f1bd909 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:23.736230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:23.737135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.737432 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.737727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] PATH_INFO: `/v3/projects/12491c74d9244fd98a1a9d934807af31` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.738929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12491c74d9244fd98a1a9d934807af31)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:23.741025 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:23.787748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12491c74d9244fd98a1a9d934807af31', 'request_id': 'req-6f8c51bf-37aa-46fb-978b-cbcce2881464'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.793218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12491c74d9244fd98a1a9d934807af31', 'request_id': 'req-6f8c51bf-37aa-46fb-978b-cbcce2881464'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.799210 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12491c74d9244fd98a1a9d934807af31', 'request_id': 'req-6f8c51bf-37aa-46fb-978b-cbcce2881464'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.811863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] The token cache is being invalidate because project 12491c74d9244fd98a1a9d934807af31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:23.812176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.812792 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-6f8c51bf-37aa-46fb-978b-cbcce2881464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:23.814344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1383/2717] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:23 2022] DELETE /identity/v3/projects/12491c74d9244fd98a1a9d934807af31 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:23.819943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.820422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.820540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.839210 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:23.840452 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:23.900208 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1335/2718] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:23.908158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.908522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.908820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.927330 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:23.928597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:23.936602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1384/2719] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:23.940754 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:23.951200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8b84d-8484-4e8e-a817-e9f4306eb9a3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:23.955867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:23.956662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.956985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.957264 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.958019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:23.958330 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:23.961085 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:23.972558 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1336/2720] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:23.976800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:23.986346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4a09-4e4c-4aa5-8704-6184c761c59d None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:23.991278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:23.991965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:23.992277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:23.992563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:23.993269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:23.995161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.023319 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1385/2721] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:23 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:24.024715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.035026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d673c56-9d3e-4824-83e1-f0e213791f68 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.094769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.095468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.095757 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.096069 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.096766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.098703 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.123224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1337/2722] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:24 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:24.124733 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.136043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ce5f-69e7-4f2e-b731-434ea6bc5df6 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.140958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.141644 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.141935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.142230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.142958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.144617 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.156427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1386/2723] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:24.160472 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.171852 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09479428-f2f8-457f-9c04-e0cfeac23d1a admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.176674 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0875256-bd18-43aa-8767-94e3ad9a686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.177324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0875256-bd18-43aa-8767-94e3ad9a686c admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.177711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0875256-bd18-43aa-8767-94e3ad9a686c admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.178068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0875256-bd18-43aa-8767-94e3ad9a686c admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.178934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0875256-bd18-43aa-8767-94e3ad9a686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.180646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0875256-bd18-43aa-8767-94e3ad9a686c admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.192360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1338/2724] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:24.196706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.207422 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e2ece-c715-4968-9531-6d0c042fa65b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.212702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.213676 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.214035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.214321 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] PATH_INFO: `/v3/projects/067b8f7bbdf14bf3baf02740a3af7b69/users/19add23632c14b448d38f5f8421b2bcb/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.229697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] RBAC: Authorizing `identity:create_grant(project_id=067b8f7bbdf14bf3baf02740a3af7b69, user_id=19add23632c14b448d38f5f8421b2bcb, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.232469 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.252796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1387/2725] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:24 2022] PUT /identity/v3/projects/067b8f7bbdf14bf3baf02740a3af7b69/users/19add23632c14b448d38f5f8421b2bcb/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:24.262972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.263269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.263554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.290534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] MFA Rules not processed for user `19add23632c14b448d38f5f8421b2bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:24.291734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:24.300789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:24.358211 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1339/2726] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:24.362667 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.367272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:24.425391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b179a-0d02-4c03-be59-1b7851a9514b admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.430297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.430897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.431194 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.431478 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.432207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.434110 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.458851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1388/2727] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:24 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:24.463614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.474207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c03243-00a4-41b1-9eb4-2b54a02fb136 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.534438 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.535448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.535448 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.535672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.536431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.538842 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.564973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1340/2728] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:24 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:24.566286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.577952 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0b8e-6c4d-4eaf-a0df-6dd94124b1e9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.582799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.583477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.583767 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.585433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.586213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.587828 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.598793 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1389/2729] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:24.603429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.613999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2df7-31b8-49a5-8f4e-8114976bfc27 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.618942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.619833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.620164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.620453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] PATH_INFO: `/v3/projects/9f586a7b529549a48f7384b96bf738e7/users/3b909510a66248d093a3ea7148bb69b7/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.637693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f586a7b529549a48f7384b96bf738e7, user_id=3b909510a66248d093a3ea7148bb69b7, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.640460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.655239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1341/2730] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:24 2022] PUT /identity/v3/projects/9f586a7b529549a48f7384b96bf738e7/users/3b909510a66248d093a3ea7148bb69b7/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:24.659258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.669624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b8a35-112c-4187-824b-d014edfbabc9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.729253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368a29f-25c4-4be0-94cb-813060b77433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.729939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368a29f-25c4-4be0-94cb-813060b77433 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.730230 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368a29f-25c4-4be0-94cb-813060b77433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.730519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368a29f-25c4-4be0-94cb-813060b77433 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.731320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368a29f-25c4-4be0-94cb-813060b77433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.733250 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368a29f-25c4-4be0-94cb-813060b77433 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.747991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1390/2731] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:24.749424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.761713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80a72-66e3-44d0-b387-9022ea8d7814 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:24.766537 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:24.767518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.767936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.768285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] PATH_INFO: `/v3/projects/9f586a7b529549a48f7384b96bf738e7/users/3b909510a66248d093a3ea7148bb69b7/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.770303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f586a7b529549a48f7384b96bf738e7, user_id=3b909510a66248d093a3ea7148bb69b7, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:24.773254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:24.783944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1342/2732] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:24 2022] PUT /identity/v3/projects/9f586a7b529549a48f7384b96bf738e7/users/3b909510a66248d093a3ea7148bb69b7/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:24.795996 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:24.796368 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:24.796666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:24.824924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] MFA Rules not processed for user `3b909510a66248d093a3ea7148bb69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:24.826136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:24.891457 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:24.901946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1391/2733] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:24.911261 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:24.916487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:25.003801 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5f9b-8014-44e1-a111-c23f40cb31fc admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:25.008427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa556d4-4449-49e1-a266-d9e2b8e46f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:25.009083 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa556d4-4449-49e1-a266-d9e2b8e46f11 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:25.009375 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa556d4-4449-49e1-a266-d9e2b8e46f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:25.009661 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa556d4-4449-49e1-a266-d9e2b8e46f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:25.020289 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa556d4-4449-49e1-a266-d9e2b8e46f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:25.021804 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa556d4-4449-49e1-a266-d9e2b8e46f11 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:25.031614 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1343/2734] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:25.447036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:25.516713 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53124f7-47e9-49ca-a2bc-8e4f1b4cb734 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:25.521353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:25.522234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:25.522525 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:25.522809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] PATH_INFO: `/v3/users/19add23632c14b448d38f5f8421b2bcb` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:25.524582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19add23632c14b448d38f5f8421b2bcb)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:25.526815 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:25.574658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19add23632c14b448d38f5f8421b2bcb'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:25.581956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19add23632c14b448d38f5f8421b2bcb'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:25.589725 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19add23632c14b448d38f5f8421b2bcb'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:25.590362 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19add23632c14b448d38f5f8421b2bcb'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:25.590968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19add23632c14b448d38f5f8421b2bcb'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:25.608557 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1392/2735] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:25 2022] DELETE /identity/v3/users/19add23632c14b448d38f5f8421b2bcb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:25.613235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:25.613531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:25.614316 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:25.627487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:25.634876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:25.636098 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:25.692881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1344/2736] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:25.703401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:25.704915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:25.763017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37900740-509b-4464-b1b6-0fed6775bed3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:25.766707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:25.767424 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:25.767647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:25.767962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:25.777695 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:25.779134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:25.788724 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1393/2737] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:26.062384 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:26.064501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:26.078733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d4de3-476a-422c-9224-bc173e70cbd6 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:26.084107 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:26.084970 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.085324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.085525 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] PATH_INFO: `/v3/projects/067b8f7bbdf14bf3baf02740a3af7b69` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.087447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067b8f7bbdf14bf3baf02740a3af7b69)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:26.089389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:26.135822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067b8f7bbdf14bf3baf02740a3af7b69', 'request_id': 'req-877dd979-d189-42a5-afbe-53db96acdad6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.141621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067b8f7bbdf14bf3baf02740a3af7b69', 'request_id': 'req-877dd979-d189-42a5-afbe-53db96acdad6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.147660 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067b8f7bbdf14bf3baf02740a3af7b69', 'request_id': 'req-877dd979-d189-42a5-afbe-53db96acdad6'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.161564 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] The token cache is being invalidate because project 067b8f7bbdf14bf3baf02740a3af7b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:26.161867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.162487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.164605 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1345/2738] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:26 2022] DELETE /identity/v3/projects/067b8f7bbdf14bf3baf02740a3af7b69 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:26.168563 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:26.178435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1e116-863a-42fc-ba34-45ea8fc2958d service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:26.195024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:26.238297 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:26.239162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.239450 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.239728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] PATH_INFO: `/v3/users/3b909510a66248d093a3ea7148bb69b7` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.240958 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b909510a66248d093a3ea7148bb69b7)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:26.242976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:26.287671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b909510a66248d093a3ea7148bb69b7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.295283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b909510a66248d093a3ea7148bb69b7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.302281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b909510a66248d093a3ea7148bb69b7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.302848 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b909510a66248d093a3ea7148bb69b7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.303460 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-12d6263b-ee73-4dc3-8c43-0869f34b432b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b909510a66248d093a3ea7148bb69b7'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.320924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1394/2739] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:26 2022] DELETE /identity/v3/users/3b909510a66248d093a3ea7148bb69b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:26.608630 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:26.610057 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:26.623845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd979-d189-42a5-afbe-53db96acdad6 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:26.688162 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:26.689029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.689318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.689598 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] PATH_INFO: `/v3/projects/9f586a7b529549a48f7384b96bf738e7` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.690781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f586a7b529549a48f7384b96bf738e7)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:26.692699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:26.732781 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:26.749758 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f586a7b529549a48f7384b96bf738e7', 'request_id': 'req-8c625c16-5be8-4647-a266-b631b3d37cd0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.755974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f586a7b529549a48f7384b96bf738e7', 'request_id': 'req-8c625c16-5be8-4647-a266-b631b3d37cd0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.762710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f586a7b529549a48f7384b96bf738e7', 'request_id': 'req-8c625c16-5be8-4647-a266-b631b3d37cd0'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.781581 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] The token cache is being invalidate because project 9f586a7b529549a48f7384b96bf738e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:26.781949 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.782952 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-8c625c16-5be8-4647-a266-b631b3d37cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:26.784662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1346/2740] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:26 2022] DELETE /identity/v3/projects/9f586a7b529549a48f7384b96bf738e7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:26.790037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.790501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.790692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.808660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:26.809856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:26.874711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1395/2741] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:26.881964 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.882362 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.882684 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.901303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:26.902503 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:26.911058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1347/2742] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:26.916037 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:26.925936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b31cc-d813-44db-88a1-67446255d021 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:26.931344 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:26.932027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.932320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.932605 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.933327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:26.933650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:26.935259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:26.952144 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1396/2743] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:37:26.953434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:26.965058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f19a4-2b80-45c8-9dcf-1ed0634eed1c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:26.969701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:26.970358 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:26.970647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:26.970928 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:26.971617 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:26.973544 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.005667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1348/2744] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:26 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:27.006887 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.017515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439d48e-7840-443b-8be4-2d113def1339 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.043409 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:27.081003 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.081683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.081975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.082260 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.082948 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.084916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.108614 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1397/2745] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:27 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:27.109901 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.120648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a78ce-697d-4e21-962c-a790e7e58c26 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.125411 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.126076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.126368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.126680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.127393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.129015 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.141137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1349/2746] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:27.145565 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.157797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1471e1-cfd9-482a-920b-b7bf86ddbc05 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.162545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94693f8-33a8-4a35-afdc-6a6f2e1c7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.163219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94693f8-33a8-4a35-afdc-6a6f2e1c7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.163510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94693f8-33a8-4a35-afdc-6a6f2e1c7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.163796 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94693f8-33a8-4a35-afdc-6a6f2e1c7de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.165120 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94693f8-33a8-4a35-afdc-6a6f2e1c7de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.166731 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94693f8-33a8-4a35-afdc-6a6f2e1c7de5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.176983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1398/2747] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:27.181352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.191258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679f157-68e7-4456-ab45-694ffa71e605 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.196132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.197010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.197297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.197589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] PATH_INFO: `/v3/projects/c0322184ef5b4cb1b3dc82cde6f23543/users/42fc29ff23f7410d85fed7929cdfbe8e/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.212999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0322184ef5b4cb1b3dc82cde6f23543, user_id=42fc29ff23f7410d85fed7929cdfbe8e, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.215646 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.228936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1350/2748] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:27 2022] PUT /identity/v3/projects/c0322184ef5b4cb1b3dc82cde6f23543/users/42fc29ff23f7410d85fed7929cdfbe8e/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:27.239530 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.239849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.240281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.266125 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] MFA Rules not processed for user `42fc29ff23f7410d85fed7929cdfbe8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:27.267324 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:27.330164 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1399/2749] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:27.364197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.365951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:27.422820 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c617582-a7de-499e-a394-863eda642ae3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.426499 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3b20c-cf32-46e1-b90f-666695bee0c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.427141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3b20c-cf32-46e1-b90f-666695bee0c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.427428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3b20c-cf32-46e1-b90f-666695bee0c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.427711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3b20c-cf32-46e1-b90f-666695bee0c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.436117 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3b20c-cf32-46e1-b90f-666695bee0c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.437538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3b20c-cf32-46e1-b90f-666695bee0c6 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.446941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1351/2750] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:27.460564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.522713 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafeb0-72f2-42b2-95db-709a6c65353b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.528182 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.529058 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.529351 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.529637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] PATH_INFO: `/v3/users/42fc29ff23f7410d85fed7929cdfbe8e` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.530878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42fc29ff23f7410d85fed7929cdfbe8e)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.532847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.571697 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:27.582060 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42fc29ff23f7410d85fed7929cdfbe8e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:27.589875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42fc29ff23f7410d85fed7929cdfbe8e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:27.596961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42fc29ff23f7410d85fed7929cdfbe8e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:27.597638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42fc29ff23f7410d85fed7929cdfbe8e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:27.598280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42fc29ff23f7410d85fed7929cdfbe8e'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:27.616052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1400/2751] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:27 2022] DELETE /identity/v3/users/42fc29ff23f7410d85fed7929cdfbe8e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:27.621046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ae3-40f7-4b28-bb4c-d6bcfc61f1f3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.621343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ae3-40f7-4b28-bb4c-d6bcfc61f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.621627 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ae3-40f7-4b28-bb4c-d6bcfc61f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.639132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-26172ae3-40f7-4b28-bb4c-d6bcfc61f1f3 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:27.640371 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-26172ae3-40f7-4b28-bb4c-d6bcfc61f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:27.691298 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:27.701855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1352/2752] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:27.712050 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:27.713476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:27.769776 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad6377-f2c3-4acb-895c-198ba35b8142 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:27.774032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:27.774681 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:27.774965 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:27.775249 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:27.784227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:27.785655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:27.795228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1401/2753] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:28.015295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.015942 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.016241 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.035506 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:28.036844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.091158 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.093749 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.113835 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0099b-f468-4a50-aa92-c24435156d92 service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.118435 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1353/2754] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:28.119799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.120689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.120981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.121333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] PATH_INFO: `/v3/projects/c0322184ef5b4cb1b3dc82cde6f23543` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.122771 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0322184ef5b4cb1b3dc82cde6f23543)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.124737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.173582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.175171 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.181699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0322184ef5b4cb1b3dc82cde6f23543', 'request_id': 'req-cdf16646-3d93-49ab-bae9-ba3533b107b5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:28.187431 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0322184ef5b4cb1b3dc82cde6f23543', 'request_id': 'req-cdf16646-3d93-49ab-bae9-ba3533b107b5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:28.193704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0322184ef5b4cb1b3dc82cde6f23543', 'request_id': 'req-cdf16646-3d93-49ab-bae9-ba3533b107b5'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:28.209296 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] The token cache is being invalidate because project c0322184ef5b4cb1b3dc82cde6f23543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:28.209589 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:28.210207 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cdf16646-3d93-49ab-bae9-ba3533b107b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:28.212730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1402/2755] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:28 2022] DELETE /identity/v3/projects/c0322184ef5b4cb1b3dc82cde6f23543 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:28.217567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ff7e4-145b-4877-a73f-bdc61471ac1b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.217975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ff7e4-145b-4877-a73f-bdc61471ac1b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.218410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ff7e4-145b-4877-a73f-bdc61471ac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.237572 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-3b4ff7e4-145b-4877-a73f-bdc61471ac1b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:28.239435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3b4ff7e4-145b-4877-a73f-bdc61471ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.254668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455341a-33d6-4aa0-ad12-57c07668fdf3 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.276519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:28.304101 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1403/2756] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:28.313404 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.313702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.313979 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.316388 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.317041 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.317328 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.317609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.319497 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.333540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:28.334723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.343196 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1404/2757] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:28.347410 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.357298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6af03-d54f-48ef-81d2-e73ac477688f None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.362215 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.362868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.363154 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.363435 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.364190 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:28.364621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.366219 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.370692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=100 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:28.379021 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1405/2758] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:37:28.381876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.383239 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.383847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.392533 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1354/2759] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:37:28.393690 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b481f4-886f-44a9-951a-ec32cb6ed20c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.399145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.399802 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.400134 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.400392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.401079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.402973 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.442578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1406/2760] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:28.447073 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.457950 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5675f17-9d26-4dc5-b664-dca02bc31ee0 service swift] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.529324 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.530009 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.530329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.530610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.531278 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.533297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.566306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1355/2761] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:28.567609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.582178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad7094-d5e3-4410-a50f-b67a8db8079a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.589770 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.590672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.591091 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.591385 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.592628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.594988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.611916 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1407/2762] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:28.614174 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.629618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1ffa-2984-40e4-aa1a-6fbb18fbb333 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.636618 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf586b4b-16a7-4e22-80f5-62a4c9861206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.637570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf586b4b-16a7-4e22-80f5-62a4c9861206 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.637859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf586b4b-16a7-4e22-80f5-62a4c9861206 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.638313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf586b4b-16a7-4e22-80f5-62a4c9861206 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.639332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf586b4b-16a7-4e22-80f5-62a4c9861206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.642409 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf586b4b-16a7-4e22-80f5-62a4c9861206 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.658195 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1356/2763] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:28.662269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.674074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3850-1af9-4ce8-a2eb-3158eebce72e admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.679236 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.680256 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.680610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.680856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] PATH_INFO: `/v3/projects/d3e9744b730847699ef91508f73ee680/users/5c936f81e8654e4eb0588b950fdfa19c/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.698850 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e9744b730847699ef91508f73ee680, user_id=5c936f81e8654e4eb0588b950fdfa19c, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.701671 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.724271 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1408/2764] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:28 2022] PUT /identity/v3/projects/d3e9744b730847699ef91508f73ee680/users/5c936f81e8654e4eb0588b950fdfa19c/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:28.728784 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.729156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.729517 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.766902 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] MFA Rules not processed for user `5c936f81e8654e4eb0588b950fdfa19c`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:28.768490 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:28.851477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1357/2765] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:28.853630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.920699 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03509b-4a11-4ed1-8ad7-381b669e7c78 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:28.925666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:28.926436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:28.926783 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:28.927138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:28.927934 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:28.930927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:28.966377 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1409/2766] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:28.968137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:28.980880 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e948e9c-af81-47ca-b329-a125e04d19f4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.040822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:29.052087 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.052724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.052994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.053320 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.053994 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.059649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.081578 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1358/2767] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:28 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:29.083451 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:29.096689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f891495-03a6-4ce2-a729-6697cd13453a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.102827 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.103659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.104122 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.104512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.105407 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.107137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.122228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1410/2768] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:29.123735 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:29.135225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372801f-c939-439b-92c8-65548d9ede55 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.141844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.142737 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.143021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.143300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] PATH_INFO: `/v3/projects/86fab01cf9224789ba7e4833435216e3/users/3be5bce72ace42a080105d307cba84b6/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.161707 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fab01cf9224789ba7e4833435216e3, user_id=3be5bce72ace42a080105d307cba84b6, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.165477 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.181731 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1359/2769] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:29 2022] PUT /identity/v3/projects/86fab01cf9224789ba7e4833435216e3/users/3be5bce72ace42a080105d307cba84b6/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:29.185567 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:29.198622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39c125-2ceb-4dc0-b161-6b52bf5e842f admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.243613 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:29.271683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fbe82-1e2a-490d-ab15-3dea9e631589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.272730 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fbe82-1e2a-490d-ab15-3dea9e631589 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.273032 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fbe82-1e2a-490d-ab15-3dea9e631589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.273373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fbe82-1e2a-490d-ab15-3dea9e631589 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.274720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fbe82-1e2a-490d-ab15-3dea9e631589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.276554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fbe82-1e2a-490d-ab15-3dea9e631589 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.287974 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1411/2770] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:29.292111 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:29.303277 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58eb4-b3b9-4443-a2b5-d02fc398f186 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.308524 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.309632 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.310306 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.310794 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] PATH_INFO: `/v3/projects/86fab01cf9224789ba7e4833435216e3/users/3be5bce72ace42a080105d307cba84b6/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.312860 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fab01cf9224789ba7e4833435216e3, user_id=3be5bce72ace42a080105d307cba84b6, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.315584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.328191 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1360/2771] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:29 2022] PUT /identity/v3/projects/86fab01cf9224789ba7e4833435216e3/users/3be5bce72ace42a080105d307cba84b6/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:29.341639 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.342140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.342313 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.375013 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] MFA Rules not processed for user `3be5bce72ace42a080105d307cba84b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:29.376405 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:29.460900 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1412/2772] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:29.476149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:29.478393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:29.551104 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e785f54-0a4f-47a7-ad31-78592daa54b9 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.556985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63df3-5e21-40c3-8c26-bb3c3a0909f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.557980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63df3-5e21-40c3-8c26-bb3c3a0909f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.558498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63df3-5e21-40c3-8c26-bb3c3a0909f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.559020 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63df3-5e21-40c3-8c26-bb3c3a0909f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.629148 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e63df3-5e21-40c3-8c26-bb3c3a0909f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.630834 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e63df3-5e21-40c3-8c26-bb3c3a0909f7 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.642904 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1361/2773] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:32.306595 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:32.378968 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec8c17-391a-4e6b-9163-b801eaa5729c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:32.384350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:32.385370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:32.385670 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:32.385959 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] PATH_INFO: `/v3/users/5c936f81e8654e4eb0588b950fdfa19c` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:32.392715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c936f81e8654e4eb0588b950fdfa19c)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:32.394765 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:32.453590 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c936f81e8654e4eb0588b950fdfa19c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.464930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c936f81e8654e4eb0588b950fdfa19c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.471534 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:32.476521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c936f81e8654e4eb0588b950fdfa19c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.477942 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c936f81e8654e4eb0588b950fdfa19c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.479583 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c936f81e8654e4eb0588b950fdfa19c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.504867 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1413/2774] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:32 2022] DELETE /identity/v3/users/5c936f81e8654e4eb0588b950fdfa19c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:32.510437 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:32.511063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:32.511063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:32.529713 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:32.530922 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:32.613551 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1362/2775] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:32.624092 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:32.626116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:32.699732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0711cd-f411-4f66-8a75-de5f2122a0c5 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:32.705307 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:32.706146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:32.706700 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:32.706998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:32.719729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:32.721547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:32.737352 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1414/2776] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:33.083911 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.085467 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:33.095494 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:33.101675 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737de4-2e96-4819-b5ae-40ccad9f1745 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.109872 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.110856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.111219 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.111577 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] PATH_INFO: `/v3/projects/d3e9744b730847699ef91508f73ee680` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.113462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e9744b730847699ef91508f73ee680)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.115667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.176430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e9744b730847699ef91508f73ee680', 'request_id': 'req-371aa79b-4911-4922-8ef4-d9c60255a5bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.184137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e9744b730847699ef91508f73ee680', 'request_id': 'req-371aa79b-4911-4922-8ef4-d9c60255a5bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.191074 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e9744b730847699ef91508f73ee680', 'request_id': 'req-371aa79b-4911-4922-8ef4-d9c60255a5bc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.206243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] The token cache is being invalidate because project d3e9744b730847699ef91508f73ee680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:33.206571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.207161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.208951 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1363/2777] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:33 2022] DELETE /identity/v3/projects/d3e9744b730847699ef91508f73ee680 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:33.213142 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.225379 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050b90f-c462-49c7-a41b-298ca80249dc service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.294371 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.295440 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.295843 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.296222 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] PATH_INFO: `/v3/users/3be5bce72ace42a080105d307cba84b6` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.297800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be5bce72ace42a080105d307cba84b6)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.300620 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.362347 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be5bce72ace42a080105d307cba84b6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.373146 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be5bce72ace42a080105d307cba84b6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.385136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be5bce72ace42a080105d307cba84b6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.386192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be5bce72ace42a080105d307cba84b6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.386937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-d0a4622b-04f2-4dbd-978c-fea39dc90485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be5bce72ace42a080105d307cba84b6'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.404927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:33.409994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1415/2778] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:33 2022] DELETE /identity/v3/users/3be5bce72ace42a080105d307cba84b6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:33.714495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.716205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:33.730979 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa79b-4911-4922-8ef4-d9c60255a5bc admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.816926 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.818141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.818402 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.818955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] PATH_INFO: `/v3/projects/86fab01cf9224789ba7e4833435216e3` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.820002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fab01cf9224789ba7e4833435216e3)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.822185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.882513 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fab01cf9224789ba7e4833435216e3', 'request_id': 'req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.894459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fab01cf9224789ba7e4833435216e3', 'request_id': 'req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.903170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fab01cf9224789ba7e4833435216e3', 'request_id': 'req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.919792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] The token cache is being invalidate because project 86fab01cf9224789ba7e4833435216e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:33.920125 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.920846 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-ffc0fa7f-70d8-462e-a277-29bcb23d2ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.922482 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1364/2779] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:33 2022] DELETE /identity/v3/projects/86fab01cf9224789ba7e4833435216e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:33.928045 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.928339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.928618 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.953072 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:33.954325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.032417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1416/2780] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:34.041021 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.041338 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.041621 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.060634 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:34.061864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.069995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1365/2781] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:34.075077 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.088136 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997406df-45a7-4b01-bfc2-0682ce880f49 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.093702 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.094329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.094608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.095062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.095797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86570) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:34.096211 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.097847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.115929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1417/2782] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:34.119374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.129845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fed5d-1d57-424c-9ad2-5369897345ab None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.136004 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.136582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.136876 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.137164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.137873 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.140178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.151142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:34.174642 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1366/2783] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:34 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:34.178851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.192415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a04494-fc10-4158-84ce-8efe36c39dd9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.262795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.262795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.262795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.262795 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] PATH_INFO: `/v3/users` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.263320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.264624 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.287833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1418/2784] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:34 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:34.291861 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.303058 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b95f1-9157-4cf6-9a96-d2e31e8810c1 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.310441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.310441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.310441 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.311026 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.312668 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.315995 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.336287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1367/2785] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:34.338035 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.349398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77582c6f-0f16-41d0-b197-eab7a2e31e49 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.360427 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf500-326e-404d-9946-33817581258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.361111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf500-326e-404d-9946-33817581258e admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.361401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf500-326e-404d-9946-33817581258e admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.361741 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf500-326e-404d-9946-33817581258e admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.363599 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf500-326e-404d-9946-33817581258e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.368150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf500-326e-404d-9946-33817581258e admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.386115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1419/2786] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:34.389508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.407025 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191762-d1ef-47b5-bda3-93b7b1c0781f admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.415193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.416778 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.417193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.417582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] PATH_INFO: `/v3/projects/b6297e9d032c4c09a674f283b698e494/users/261f75ba9ec043869f1d1ead931c33f2/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.437439 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6297e9d032c4c09a674f283b698e494, user_id=261f75ba9ec043869f1d1ead931c33f2, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.441313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.461376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1368/2787] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:34 2022] PUT /identity/v3/projects/b6297e9d032c4c09a674f283b698e494/users/261f75ba9ec043869f1d1ead931c33f2/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:34.473306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444129-749d-4b40-afd3-8091dab2520f None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.473946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444129-749d-4b40-afd3-8091dab2520f None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.474433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444129-749d-4b40-afd3-8091dab2520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.503981 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-a7444129-749d-4b40-afd3-8091dab2520f None None] MFA Rules not processed for user `261f75ba9ec043869f1d1ead931c33f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:34.505168 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-a7444129-749d-4b40-afd3-8091dab2520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.574109 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:34.586626 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1420/2788] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:34.598590 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.600427 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.671017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109650d2-b4cf-4688-af0d-699ceccc8833 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.675673 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.676430 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.676813 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.677251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.687818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.689405 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.699864 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1369/2789] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:36.204178 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f3f1-efc7-42df-aa73-221281fd27c3 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.204726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f3f1-efc7-42df-aa73-221281fd27c3 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.204726 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f3f1-efc7-42df-aa73-221281fd27c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.226150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-aca2f3f1-efc7-42df-aa73-221281fd27c3 None None] MFA Rules not processed for user `261f75ba9ec043869f1d1ead931c33f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:36.228292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-aca2f3f1-efc7-42df-aa73-221281fd27c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:36.236714 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1421/2790] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:41.620587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:41.622181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:41.695575 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995945-d795-4f26-aa70-5673dc187b2e service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:41.700267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:41.701192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:41.701662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:41.701858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:41.704317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:41.797383 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:41.799213 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:41.805877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:41.822281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1370/2791] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:44.729836 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:44.730280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:44.730443 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:44.748494 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:44.749693 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:44.802729 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1422/2792] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:44.815487 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:44.816943 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:44.886722 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbc40-c645-4566-a266-925dbde0c0e3 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:44.891773 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:44.892394 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:44.892689 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:44.892967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:44.901756 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:44.903360 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:44.912313 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1371/2793] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:45.444339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:45.457306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049367-5350-4b70-9e1b-7d6529a4988a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:45.472844 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:45.473521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:45.473924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:45.474360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:45.480118 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:45.500346 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:45.502132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:45.515516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1423/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:46.831204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:46.832652 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:46.903802 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b17ee-5db1-4bb3-9eb8-e629ddd4166c service swift] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:46.909458 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:46.910715 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:46.911027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:46.911453 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] PATH_INFO: `/v3/users/af108fa5e32b4c6a907d43005af96bda` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:46.915051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af108fa5e32b4c6a907d43005af96bda)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:46.917459 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:46.965337 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af108fa5e32b4c6a907d43005af96bda'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:46.972382 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af108fa5e32b4c6a907d43005af96bda'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:46.979696 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af108fa5e32b4c6a907d43005af96bda'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:46.980368 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af108fa5e32b4c6a907d43005af96bda'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:46.980977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-cd79667f-b142-4624-8670-801072f16016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af108fa5e32b4c6a907d43005af96bda'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:46.998450 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1372/2795] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:46 2022] DELETE /identity/v3/users/af108fa5e32b4c6a907d43005af96bda => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:47.179738 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:47.191664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcce7ff-71b6-406f-838f-3542d0904d6e service neutron] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:47.251323 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:47.252232 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:47.252521 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:47.252803 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] PATH_INFO: `/v3/projects/42ee305b3bd149f3bb9fbd5ea877548d` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:47.253984 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ee305b3bd149f3bb9fbd5ea877548d)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:47.255935 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:47.304227 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ee305b3bd149f3bb9fbd5ea877548d', 'request_id': 'req-7588a880-ec32-4783-be63-d2d306e21b60'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:47.309489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ee305b3bd149f3bb9fbd5ea877548d', 'request_id': 'req-7588a880-ec32-4783-be63-d2d306e21b60'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:47.315461 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ee305b3bd149f3bb9fbd5ea877548d', 'request_id': 'req-7588a880-ec32-4783-be63-d2d306e21b60'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:47.328641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] The token cache is being invalidate because project 42ee305b3bd149f3bb9fbd5ea877548d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:47.328930 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:47.329578 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:47.331108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1424/2796] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:47 2022] DELETE /identity/v3/projects/42ee305b3bd149f3bb9fbd5ea877548d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:54.142800 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8d52-556c-4e4d-bd0b-f086665f2808 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.143312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8d52-556c-4e4d-bd0b-f086665f2808 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.143407 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8d52-556c-4e4d-bd0b-f086665f2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.156060 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.162398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-a37a8d52-556c-4e4d-bd0b-f086665f2808 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.164930 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-a37a8d52-556c-4e4d-bd0b-f086665f2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.219976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1373/2797] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:54.232727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.234378 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.249389 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.306415 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588a880-ec32-4783-be63-d2d306e21b60 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.311272 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.311936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.312221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.312499 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.320504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.322074 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.330004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1425/2798] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:54.830183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030751-7f7f-4a5e-ab19-d9af789f27bf None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.830474 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030751-7f7f-4a5e-ab19-d9af789f27bf None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.830755 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030751-7f7f-4a5e-ab19-d9af789f27bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.848691 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-11030751-7f7f-4a5e-ab19-d9af789f27bf None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.849877 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-11030751-7f7f-4a5e-ab19-d9af789f27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.856892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1374/2799] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:54.869814 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.880363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d4278-d8d9-470a-8126-c06cbe8cab12 service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.885946 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.886582 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.886876 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.887165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.895176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.896807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.904906 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1426/2800] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:55.096887 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921d862-1716-4648-8526-7c68f77b4a3e None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.097179 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921d862-1716-4648-8526-7c68f77b4a3e None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.097460 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921d862-1716-4648-8526-7c68f77b4a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.115035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-1921d862-1716-4648-8526-7c68f77b4a3e None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:55.116267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1921d862-1716-4648-8526-7c68f77b4a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.123973 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1375/2801] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:55.136162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.146746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4590-d746-4d6e-8a04-7d15aab0cb61 service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.151971 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.152610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.152902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.153214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.161279 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.162863 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.171269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1427/2802] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:37:55.484068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.484554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.484662 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.503317 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] MFA Rules not processed for user `30d9ec9bc1514acdb359d5959e1597c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:55.504554 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.512976 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1376/2803] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:55.525711 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.536358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fd8fa-e8ff-4f24-bb28-99b52465c624 service swift] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.541686 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57deca55-c6fe-4a8e-9092-398fd91ce6ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f7484f9ef764101977c9da152a7ab75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.542327 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57deca55-c6fe-4a8e-9092-398fd91ce6ac service swift] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.542623 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57deca55-c6fe-4a8e-9092-398fd91ce6ac service swift] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.542912 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57deca55-c6fe-4a8e-9092-398fd91ce6ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.551055 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57deca55-c6fe-4a8e-9092-398fd91ce6ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.552687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57deca55-c6fe-4a8e-9092-398fd91ce6ac service swift] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.561123 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1428/2804] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:57.595698 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:57.597173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:57.662005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f74b-4412-49a0-b754-735bffcc0c15 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:57.667103 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:57.668036 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:57.668329 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:57.668612 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] PATH_INFO: `/v3/users/261f75ba9ec043869f1d1ead931c33f2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:57.669830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261f75ba9ec043869f1d1ead931c33f2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:57.671765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:57.717769 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261f75ba9ec043869f1d1ead931c33f2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:57.724833 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261f75ba9ec043869f1d1ead931c33f2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:57.732469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261f75ba9ec043869f1d1ead931c33f2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:57.733105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261f75ba9ec043869f1d1ead931c33f2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:57.733982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261f75ba9ec043869f1d1ead931c33f2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:57.751699 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1377/2805] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:57 2022] DELETE /identity/v3/users/261f75ba9ec043869f1d1ead931c33f2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:57.756202 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:57.756666 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:57.756799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:57.774629 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:57.775851 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:57.834821 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1429/2806] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:57.845035 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:57.846466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:57.860760 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:57.906819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79905-3719-423e-bec1-52a801f35a63 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:57.910712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:57.911356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:57.911647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:57.911963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:57.924124 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:57.925483 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:57.935389 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1378/2807] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:58.108786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:58.110274 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:58.124735 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cdc4a-f03e-44d5-bd55-51d6c00e9603 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:58.129369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:58.130258 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:58.130545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:58.130826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] PATH_INFO: `/v3/projects/b6297e9d032c4c09a674f283b698e494` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:58.132696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6297e9d032c4c09a674f283b698e494)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:58.134800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:58.181292 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6297e9d032c4c09a674f283b698e494', 'request_id': 'req-cf799be7-de00-4db1-9b9a-de19f4e87c5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.185766 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:58.187400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6297e9d032c4c09a674f283b698e494', 'request_id': 'req-cf799be7-de00-4db1-9b9a-de19f4e87c5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.195536 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6297e9d032c4c09a674f283b698e494', 'request_id': 'req-cf799be7-de00-4db1-9b9a-de19f4e87c5c'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.208226 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] The token cache is being invalidate because project b6297e9d032c4c09a674f283b698e494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:58.208515 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.209135 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-cf799be7-de00-4db1-9b9a-de19f4e87c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.211878 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1430/2808] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:58 2022] DELETE /identity/v3/projects/b6297e9d032c4c09a674f283b698e494 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:07.931080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=21 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:08.205248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:25.630622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:25.632609 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:25.728153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148301-61df-48ae-a3cb-46d59d406922 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:25.810066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:25.810932 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:25.811300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:25.811693 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:25.813845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:25.827136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:25.828818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:25.842592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1379/2809] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:28.578381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:28.578962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:28.578962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:28.597350 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] MFA Rules not processed for user `568d5348695e4dfeb57350dbc404ec48`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:28.598552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:28.653343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1431/2810] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:29.268097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:29.269573 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:29.339050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffb546-7fe2-454f-823c-8fc8c9a4a149 service nova] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:29.344053 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:29.344695 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:29.344982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:29.345263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:29.347005 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:29.358142 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:29.359977 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:29.370229 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1380/2811] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:31.159203 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:31.160707 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:31.221486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34bd7d-1a08-4866-885b-ebc3c665de95 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:31.225283 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:31.225937 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:31.226228 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:31.226510 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:31.228391 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:31.238655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:31.240132 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5e98e-bd9e-40c4-ac5e-f3c1029d516a service neutron] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:31.248275 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1432/2812] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:39.365468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=94 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:41.245381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=51 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:04.741818 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:04.754399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c285f7-b265-4827-8d9e-6b6d18dd39f7 service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:04.758063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:04.758700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:04.758984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:04.759263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:04.761019 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:04.795607 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:04.797023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:04.806109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1381/2813] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:08.163163 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:08.163674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:08.163773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:08.181807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] MFA Rules not processed for user `568d5348695e4dfeb57350dbc404ec48`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:40:08.182989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:08.190373 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1433/2814] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:40:08.485619 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:08.520169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd3cb0-a115-453d-9710-883c7f68df57 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:08.523692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:08.524359 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:08.524645 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:08.524921 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:08.526676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:08.547365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:08.548807 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:08.557604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1382/2815] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:18.176425 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:18.202602 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:18.204223 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:18.231186 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92cf26-d925-4c7a-9930-e8b28c116c24 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:18.238467 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:18.239138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:18.239552 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:18.239902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:18.242213 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:18.256576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:18.257927 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:18.270902 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1434/2816] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:18.553811 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=39 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:28.265242 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=9 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:39.777550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:39.786217 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7d41-f7a1-4fd9-8327-f8932193b01b service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:39.790391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:39.791030 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:39.791315 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:39.791592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:39.793399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:39.877205 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:39.878626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:39.897108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1383/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:42.620820 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.622241 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.636831 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.666164 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9e01-092e-4adb-bfb9-8416b117837b service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.671694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9aa49-cd00-4998-a576-4623c8adc7d2 service nova] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.673207 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.673934 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.674292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.674763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.676597 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.679366 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.680251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.680547 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.680833 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.682929 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.690893 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.692682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.704476 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.706444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.712334 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1384/2818] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:42.723587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.727376 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.743637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1435/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:42.753451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5e784-f89a-4eca-805f-779a0408d73b service placement] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.759649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.760747 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.761105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.761451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] PATH_INFO: `/v3/users/568d5348695e4dfeb57350dbc404ec48` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.762939 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=568d5348695e4dfeb57350dbc404ec48)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.768212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.820532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568d5348695e4dfeb57350dbc404ec48'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:42.828654 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568d5348695e4dfeb57350dbc404ec48'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:42.836555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568d5348695e4dfeb57350dbc404ec48'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:42.837251 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568d5348695e4dfeb57350dbc404ec48'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:42.837969 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-72fd92e8-471d-4711-81af-5fd60fd4d0bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568d5348695e4dfeb57350dbc404ec48'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:42.856410 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1385/2820] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:42 2022] DELETE /identity/v3/users/568d5348695e4dfeb57350dbc404ec48 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:43.035919 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.047829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d8a2-942e-4dad-9406-18dbf9494fc4 service placement] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.108413 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.109281 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.109570 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.109852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] PATH_INFO: `/v3/projects/ff1ced1dfccb472a81a7502002aab2c2` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.111341 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1ced1dfccb472a81a7502002aab2c2)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.113339 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.160145 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1ced1dfccb472a81a7502002aab2c2', 'request_id': 'req-393fe7c8-b7d2-4645-b028-521f6a78ea4d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.166687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1ced1dfccb472a81a7502002aab2c2', 'request_id': 'req-393fe7c8-b7d2-4645-b028-521f6a78ea4d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.174089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1ced1dfccb472a81a7502002aab2c2', 'request_id': 'req-393fe7c8-b7d2-4645-b028-521f6a78ea4d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.189195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] The token cache is being invalidate because project ff1ced1dfccb472a81a7502002aab2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:43.189486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.190358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-393fe7c8-b7d2-4645-b028-521f6a78ea4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.196259 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1436/2821] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:43 2022] DELETE /identity/v3/projects/ff1ced1dfccb472a81a7502002aab2c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:43.197903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.198196 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.198480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.219473 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.260898 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:43.262110 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.329343 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1386/2822] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:43.338243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.338541 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.338822 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.357221 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:43.358441 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.366524 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1437/2823] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:43.370531 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.380091 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eba81-0ef5-4994-87ca-cc3427447262 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.385342 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.385996 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.386286 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.386569 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.387295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:43.387610 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.389242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.402048 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1387/2824] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:43.405481 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.415520 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef6f0-7ce5-4f25-9a4d-6d14483f44b7 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.420174 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.420826 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.421111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.421388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.422068 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.423988 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.449137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1438/2825] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:43 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:43.453143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.464308 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf87ea-50db-4ad8-88d7-c1df570e2e52 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.523850 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.524552 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.524843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.525122 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.525803 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.527726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.548192 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1388/2826] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:43 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:43.552337 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.563162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47b8c2-b527-4762-883f-759076c690ec admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.567772 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.568463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.568753 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.570036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.570778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.572436 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.582732 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1439/2827] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:43.587247 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.597242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3e9d5-17cf-4c33-bcf4-0caec1c57a3e admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.601981 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66ed7b-c3e7-4ba1-87f3-2afd9a095e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.602631 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66ed7b-c3e7-4ba1-87f3-2afd9a095e30 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.602918 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66ed7b-c3e7-4ba1-87f3-2afd9a095e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.603197 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66ed7b-c3e7-4ba1-87f3-2afd9a095e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.603946 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66ed7b-c3e7-4ba1-87f3-2afd9a095e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.605553 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66ed7b-c3e7-4ba1-87f3-2afd9a095e30 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.615532 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1389/2828] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:43.619662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.629528 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea15d7-4eb4-47d7-8e19-4d25cc2c71c9 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.634593 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.635456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.635737 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.636052 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] PATH_INFO: `/v3/projects/439639818a22487a8f8412fa41719997/users/6ae92dab320e4546ad1b1c0b7aa604dc/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.650715 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439639818a22487a8f8412fa41719997, user_id=6ae92dab320e4546ad1b1c0b7aa604dc, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.653446 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.655542 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.667680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1440/2829] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:43 2022] PUT /identity/v3/projects/439639818a22487a8f8412fa41719997/users/6ae92dab320e4546ad1b1c0b7aa604dc/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:43.677656 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.678143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.678248 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.704855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] MFA Rules not processed for user `6ae92dab320e4546ad1b1c0b7aa604dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:43.706063 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.746570 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.771542 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1390/2830] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:43.783388 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.785150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.885357 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea557bc-6588-4aca-89b0-dd621763d361 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.890857 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a136460-c893-439d-8cd2-d20d23113ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '450a31adc83e4bf0a8b21c86806981a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.891501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a136460-c893-439d-8cd2-d20d23113ceb service nova] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.891786 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a136460-c893-439d-8cd2-d20d23113ceb service nova] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.892096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a136460-c893-439d-8cd2-d20d23113ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.900498 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a136460-c893-439d-8cd2-d20d23113ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.902073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a136460-c893-439d-8cd2-d20d23113ceb service nova] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.910761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1441/2831] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:46.566108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.626180 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b0350-0a31-4475-bd43-4df1f1086d86 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.630925 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.631792 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.632108 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.632398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] PATH_INFO: `/v3/users/6ae92dab320e4546ad1b1c0b7aa604dc` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.633580 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae92dab320e4546ad1b1c0b7aa604dc)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.635493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.681903 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae92dab320e4546ad1b1c0b7aa604dc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.688235 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae92dab320e4546ad1b1c0b7aa604dc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.695287 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae92dab320e4546ad1b1c0b7aa604dc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.696269 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae92dab320e4546ad1b1c0b7aa604dc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.696936 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae92dab320e4546ad1b1c0b7aa604dc'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.713875 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1391/2832] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:46 2022] DELETE /identity/v3/users/6ae92dab320e4546ad1b1c0b7aa604dc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:46.718504 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.718964 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.719082 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.736839 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:46.738017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.795474 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1442/2833] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:46.805154 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.806549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.863728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96407a1-7a42-43d6-a8d7-d88894c3c3ee admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.867710 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d5a99-60b8-4d99-bd0c-307ecaacc3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.868390 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d5a99-60b8-4d99-bd0c-307ecaacc3cb service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.868682 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d5a99-60b8-4d99-bd0c-307ecaacc3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.868967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d5a99-60b8-4d99-bd0c-307ecaacc3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.878017 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d5a99-60b8-4d99-bd0c-307ecaacc3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.879451 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d5a99-60b8-4d99-bd0c-307ecaacc3cb service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.889655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1392/2834] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:41:47.161966 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.163466 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.178762 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d089-e44c-469a-bbed-0a522f0906cf None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.184027 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.184897 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.185184 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.185522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] PATH_INFO: `/v3/projects/439639818a22487a8f8412fa41719997` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.186751 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439639818a22487a8f8412fa41719997)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.188709 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.235023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:47.236854 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439639818a22487a8f8412fa41719997', 'request_id': 'req-108c2ca3-9f49-44b6-89fd-564112350d94'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.243924 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439639818a22487a8f8412fa41719997', 'request_id': 'req-108c2ca3-9f49-44b6-89fd-564112350d94'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.250594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439639818a22487a8f8412fa41719997', 'request_id': 'req-108c2ca3-9f49-44b6-89fd-564112350d94'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.264102 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] The token cache is being invalidate because project 439639818a22487a8f8412fa41719997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:47.264398 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.265033 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-108c2ca3-9f49-44b6-89fd-564112350d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.266633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1443/2835] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:47 2022] DELETE /identity/v3/projects/439639818a22487a8f8412fa41719997 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:47.271547 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.271843 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.272149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.279163 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:47.295479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:47.296724 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.357139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1393/2836] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:47.365189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.365489 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.365778 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.384320 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:47.385503 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.393300 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1444/2837] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:47.397398 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.407534 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d637de4-f8fb-4de5-b530-41fb1cbf0bd4 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.412299 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.412944 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.413230 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.413507 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.414339 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:47.414649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.416270 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.427479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1394/2838] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:47.431692 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.441069 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4ef2-89a7-469c-bc97-8f0b213a71fc None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.446728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.447375 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.447663 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.447975 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.448662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.450564 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.476871 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1445/2839] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:47.481126 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.491275 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17311f-033b-4a7b-9194-de51c9ea666d admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.546862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.547527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.547817 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.548129 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.548822 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.550733 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.571193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1395/2840] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:47.575401 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.586089 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2df9f-3d71-44c2-bd98-9340884b5c39 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.590705 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.591361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.591649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.591961 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.592704 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.594291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.605998 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1446/2841] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:47.609957 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.621265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd329-78d8-48a9-ae09-75ac2f3ae0e2 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.626967 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd95601-a99b-4d10-b5bb-b8cca1d8f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.627637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd95601-a99b-4d10-b5bb-b8cca1d8f005 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.627966 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd95601-a99b-4d10-b5bb-b8cca1d8f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.628254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd95601-a99b-4d10-b5bb-b8cca1d8f005 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.628993 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd95601-a99b-4d10-b5bb-b8cca1d8f005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.630586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd95601-a99b-4d10-b5bb-b8cca1d8f005 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.642559 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1396/2842] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:47.646890 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.657550 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4817d5-9c3a-49b5-9f06-4ff5123a1df3 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.662083 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.662957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.663253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.663519 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] PATH_INFO: `/v3/projects/89aa4aae86bd4d7584e9bbb3d16e91de/users/9ce7da3890734d3698d98215a900f0fd/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.678291 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89aa4aae86bd4d7584e9bbb3d16e91de, user_id=9ce7da3890734d3698d98215a900f0fd, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.681214 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.693985 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1447/2843] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:47 2022] PUT /identity/v3/projects/89aa4aae86bd4d7584e9bbb3d16e91de/users/9ce7da3890734d3698d98215a900f0fd/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:47.706153 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.706447 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.706728 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.733849 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] MFA Rules not processed for user `9ce7da3890734d3698d98215a900f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:47.735075 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.793258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:47.799351 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1397/2844] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:47.803755 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.865062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117f2c-31a4-4f73-9335-bc44bc331226 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.869723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.870386 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.870677 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.870962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.871659 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.873608 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.898538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1448/2845] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:47.902495 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.913029 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57502b90-8c80-4c24-8528-d7acbfc4539d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.969222 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.969895 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.970185 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.970468 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.971151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.973115 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.996003 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1398/2846] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:48.000140 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.011496 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8980d-0d0e-4395-975d-2e0b1fa67039 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.016071 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.016728 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.017017 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.017302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.018044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.019630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.031061 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1449/2847] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:48.035133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.045170 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839123b-a38a-45aa-9029-0503da927287 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.049963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.050907 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.051204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.051491 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] PATH_INFO: `/v3/projects/01fa56289c834702ad8ef2ac73a008bb/users/f05abfd24e724345b2b1d0ad2a047597/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.068297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fa56289c834702ad8ef2ac73a008bb, user_id=f05abfd24e724345b2b1d0ad2a047597, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.071527 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.084321 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1399/2848] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:48 2022] PUT /identity/v3/projects/01fa56289c834702ad8ef2ac73a008bb/users/f05abfd24e724345b2b1d0ad2a047597/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:48.089400 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.099650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda195ae-b97d-41b7-b3ee-ce2596cc23d2 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.143165 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:48.157721 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6370be-0a92-45c9-81cc-5069ed12ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.158403 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6370be-0a92-45c9-81cc-5069ed12ce62 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.158689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6370be-0a92-45c9-81cc-5069ed12ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.158969 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6370be-0a92-45c9-81cc-5069ed12ce62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.159689 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6370be-0a92-45c9-81cc-5069ed12ce62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.161336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6370be-0a92-45c9-81cc-5069ed12ce62 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.171044 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1450/2849] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:48.175183 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.185466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da90abf-ce0f-40b7-b869-2315243db217 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.190161 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.191066 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.191347 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.191622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] PATH_INFO: `/v3/projects/01fa56289c834702ad8ef2ac73a008bb/users/f05abfd24e724345b2b1d0ad2a047597/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.193640 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fa56289c834702ad8ef2ac73a008bb, user_id=f05abfd24e724345b2b1d0ad2a047597, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.197022 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.207038 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1400/2850] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:48 2022] PUT /identity/v3/projects/01fa56289c834702ad8ef2ac73a008bb/users/f05abfd24e724345b2b1d0ad2a047597/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:48.217588 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.217880 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.218162 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.244406 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] MFA Rules not processed for user `f05abfd24e724345b2b1d0ad2a047597`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:48.246506 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:48.316852 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1451/2851] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:48.328292 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.330001 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:48.388280 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d36cc-60a1-4bfb-80bc-1c7dd33d0b27 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.391948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.392593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.392886 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.393227 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.449657 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.451093 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.459953 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1401/2852] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:51.002096 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:51.012908 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8702be2-4cf8-47d0-91f5-8f18a1c3986a None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:51.016512 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac623e-b7c8-45ab-86a0-a99d6030a5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:51.017181 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac623e-b7c8-45ab-86a0-a99d6030a5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:51.017471 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac623e-b7c8-45ab-86a0-a99d6030a5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:51.017748 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac623e-b7c8-45ab-86a0-a99d6030a5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:51.027073 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac623e-b7c8-45ab-86a0-a99d6030a5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:51.028540 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac623e-b7c8-45ab-86a0-a99d6030a5b4 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:51.037894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1452/2853] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:58.455844 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:01.033680 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=48 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:03.418265 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.480593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605541-4c14-483a-a8a9-9032fb842ce1 service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.485151 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.486027 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.486567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.486853 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] PATH_INFO: `/v3/users/9ce7da3890734d3698d98215a900f0fd` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.488072 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce7da3890734d3698d98215a900f0fd)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.489991 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.534508 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce7da3890734d3698d98215a900f0fd'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.542311 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce7da3890734d3698d98215a900f0fd'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.549297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce7da3890734d3698d98215a900f0fd'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.549920 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce7da3890734d3698d98215a900f0fd'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.550522 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce7da3890734d3698d98215a900f0fd'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.571471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1402/2854] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:03 2022] DELETE /identity/v3/users/9ce7da3890734d3698d98215a900f0fd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:03.576161 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.576684 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.576797 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.595412 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:03.596641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.655638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1453/2855] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:03.665697 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.667081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.723046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0f397-bb79-4a8c-a822-606613140245 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.726647 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.727823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.728137 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.728429 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.737589 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.739010 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.757708 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1403/2856] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:04.027353 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.029062 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.042333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78374-4fae-4aa5-bad4-024a3c816121 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.047509 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.048428 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.048723 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.049010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] PATH_INFO: `/v3/projects/89aa4aae86bd4d7584e9bbb3d16e91de` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.050360 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89aa4aae86bd4d7584e9bbb3d16e91de)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.052331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.099938 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89aa4aae86bd4d7584e9bbb3d16e91de', 'request_id': 'req-9d946aa3-fec3-40af-93bd-d654b5123f2d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.105664 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89aa4aae86bd4d7584e9bbb3d16e91de', 'request_id': 'req-9d946aa3-fec3-40af-93bd-d654b5123f2d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.112133 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89aa4aae86bd4d7584e9bbb3d16e91de', 'request_id': 'req-9d946aa3-fec3-40af-93bd-d654b5123f2d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.124773 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] The token cache is being invalidate because project 89aa4aae86bd4d7584e9bbb3d16e91de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:04.125065 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.125687 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.127234 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1454/2857] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:04 2022] DELETE /identity/v3/projects/89aa4aae86bd4d7584e9bbb3d16e91de => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:04.131242 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.141444 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11170-1ee5-4382-ba41-ed81083989ab service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.159425 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:04.199422 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.200178 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.200465 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.200740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] PATH_INFO: `/v3/users/f05abfd24e724345b2b1d0ad2a047597` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.201955 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05abfd24e724345b2b1d0ad2a047597)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.203947 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.253204 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05abfd24e724345b2b1d0ad2a047597'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.260622 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05abfd24e724345b2b1d0ad2a047597'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.268258 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05abfd24e724345b2b1d0ad2a047597'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.268885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05abfd24e724345b2b1d0ad2a047597'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.269502 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-74f532a7-3ee9-4e19-bffa-258e30c36b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05abfd24e724345b2b1d0ad2a047597'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.287374 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1404/2858] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:04 2022] DELETE /identity/v3/users/f05abfd24e724345b2b1d0ad2a047597 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:04.555931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.557433 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.571286 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946aa3-fec3-40af-93bd-d654b5123f2d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.628926 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.629801 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.630115 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.630399 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] PATH_INFO: `/v3/projects/01fa56289c834702ad8ef2ac73a008bb` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.631594 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fa56289c834702ad8ef2ac73a008bb)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.634308 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.664419 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:04.682277 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fa56289c834702ad8ef2ac73a008bb', 'request_id': 'req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.687903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fa56289c834702ad8ef2ac73a008bb', 'request_id': 'req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.694026 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fa56289c834702ad8ef2ac73a008bb', 'request_id': 'req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.706128 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] The token cache is being invalidate because project 01fa56289c834702ad8ef2ac73a008bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:04.706418 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.707031 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-0d19fd6f-8cde-4c03-97ae-5c2c2ad05309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.708633 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1455/2859] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:04 2022] DELETE /identity/v3/projects/01fa56289c834702ad8ef2ac73a008bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:04.713701 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.714226 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.714327 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.732585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:04.733776 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.792885 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1405/2860] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:04.801674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.801970 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.802253 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.821255 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:04.822449 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.830643 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1456/2861] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:04.834529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.844424 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7d232-0d4b-484d-ac6c-f2445000c21d None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.848931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.849593 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.849859 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.850136 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.850854 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:04.851186 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.853511 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.864982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1406/2862] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:04.870280 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.879630 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8308c-e424-48bc-8177-66d4fb91cb3c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.884363 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.885016 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.885306 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.885622 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.886329 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.888266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.914233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1457/2863] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:04.918648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.928700 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c1dad-73b4-4777-863c-450cb0cdcfff admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.960181 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:04.992498 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.993169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.993462 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.993771 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.994466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.996399 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.014855 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1407/2864] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:05.019004 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.029870 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed189fd-19f0-4449-9993-5539b931fa8d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.034458 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.035111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.035395 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.035672 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.036463 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.038051 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.048837 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1458/2865] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:42:05.052867 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.062770 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14364ba-5e80-4d30-af8d-6cb6a45b1cdb admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.067318 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82013bc-9a04-4391-8647-7ef77bef5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.068007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82013bc-9a04-4391-8647-7ef77bef5384 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.068294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82013bc-9a04-4391-8647-7ef77bef5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.068574 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82013bc-9a04-4391-8647-7ef77bef5384 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.069297 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82013bc-9a04-4391-8647-7ef77bef5384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.070919 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82013bc-9a04-4391-8647-7ef77bef5384 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.081446 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1408/2866] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:05.085587 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.096278 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca982c7-0f2f-42fd-b48e-707a2ac80196 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.100849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.102343 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.102641 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.102915 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] PATH_INFO: `/v3/projects/7b0047b467ef4508bba6852e56ecb358/users/742dbce63dba4348bb2dc9953d91afe2/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.117251 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0047b467ef4508bba6852e56ecb358, user_id=742dbce63dba4348bb2dc9953d91afe2, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.119920 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.132627 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1459/2867] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:05 2022] PUT /identity/v3/projects/7b0047b467ef4508bba6852e56ecb358/users/742dbce63dba4348bb2dc9953d91afe2/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:05.142824 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.143128 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.143418 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.171440 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] MFA Rules not processed for user `742dbce63dba4348bb2dc9953d91afe2`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:05.172714 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.236365 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1409/2868] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:05.240807 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.303416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b3cf-13ea-45ac-8ead-80a268b520c0 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.308660 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.309317 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.309610 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.309895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.310694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.312656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.337421 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1460/2869] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:05.341469 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.352692 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ab4eb-118d-4b49-9edc-c7499f01ffb1 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.411431 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.412149 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.412443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.412726 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.413721 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.416663 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.436672 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1410/2870] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:05.440637 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.450941 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a5384-d63e-485d-ae57-e27cfdf7a952 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.455522 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.456216 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.456514 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.456798 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.457554 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.459150 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.469655 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1461/2871] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:05.473616 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.484193 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7ab9-cb76-4c1b-a387-c7fb999975ad admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.489081 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.489916 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.490200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.490479 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] PATH_INFO: `/v3/projects/445f1dbb020846fea4ca14f72eabcbdd/users/c8d345505dff4e8eadedc92c69e987f9/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.504940 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=445f1dbb020846fea4ca14f72eabcbdd, user_id=c8d345505dff4e8eadedc92c69e987f9, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.507586 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.521049 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1411/2872] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:05 2022] PUT /identity/v3/projects/445f1dbb020846fea4ca14f72eabcbdd/users/c8d345505dff4e8eadedc92c69e987f9/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:05.525597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.535548 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaaa8f-652d-4dfb-ae70-9e186f7e294c admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.555925 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:05.594638 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9420b18-13ad-47e0-9ddd-65b3807517fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.595304 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9420b18-13ad-47e0-9ddd-65b3807517fe admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.595597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9420b18-13ad-47e0-9ddd-65b3807517fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.595907 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9420b18-13ad-47e0-9ddd-65b3807517fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.596647 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9420b18-13ad-47e0-9ddd-65b3807517fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.598248 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9420b18-13ad-47e0-9ddd-65b3807517fe admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.607882 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1462/2873] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:05.612303 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.618391 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:05.624529 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a831-5446-4182-aead-65241783afdd admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.629404 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.630272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.630565 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.630847 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] PATH_INFO: `/v3/projects/445f1dbb020846fea4ca14f72eabcbdd/users/c8d345505dff4e8eadedc92c69e987f9/roles/e4303aac64d845f886dcf1e0f14c4fc6` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.632858 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445f1dbb020846fea4ca14f72eabcbdd, user_id=c8d345505dff4e8eadedc92c69e987f9, role_id=e4303aac64d845f886dcf1e0f14c4fc6)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.635819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.646224 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1412/2874] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:05 2022] PUT /identity/v3/projects/445f1dbb020846fea4ca14f72eabcbdd/users/c8d345505dff4e8eadedc92c69e987f9/roles/e4303aac64d845f886dcf1e0f14c4fc6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:05.656847 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.657332 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.657444 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.683819 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] MFA Rules not processed for user `c8d345505dff4e8eadedc92c69e987f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:05.685036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.753036 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1463/2875] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:05.764068 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.765865 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.822655 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d7dab-e654-4090-ae3c-8305abdbe7f3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.826259 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.826892 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.827177 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.827455 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.882094 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.883914 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.892819 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1413/2876] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:10.035287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:10.036712 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:10.049005 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91e51c-db75-43a2-b047-9a6445a1c771 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:10.052576 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c751d-1aea-4ef7-a5f1-6595fe7f4fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:10.053217 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c751d-1aea-4ef7-a5f1-6595fe7f4fcc service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:10.053501 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c751d-1aea-4ef7-a5f1-6595fe7f4fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:10.053777 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c751d-1aea-4ef7-a5f1-6595fe7f4fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:10.063931 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c751d-1aea-4ef7-a5f1-6595fe7f4fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:10.065359 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c751d-1aea-4ef7-a5f1-6595fe7f4fcc service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:10.074928 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1464/2877] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:14.926908 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:14.991538 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2097-5028-4c27-803f-59243290312e service cinder] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:14.996881 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:14.997752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:14.998046 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:14.998332 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] PATH_INFO: `/v3/users/742dbce63dba4348bb2dc9953d91afe2` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:14.999526 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742dbce63dba4348bb2dc9953d91afe2)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.001480 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.045649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.047199 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742dbce63dba4348bb2dc9953d91afe2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.054471 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742dbce63dba4348bb2dc9953d91afe2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.062584 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742dbce63dba4348bb2dc9953d91afe2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.063243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742dbce63dba4348bb2dc9953d91afe2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.063851 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742dbce63dba4348bb2dc9953d91afe2'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.081243 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1414/2878] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:14 2022] DELETE /identity/v3/users/742dbce63dba4348bb2dc9953d91afe2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:15.085694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.086172 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.086284 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.103939 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:15.105127 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.162392 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1465/2879] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:15.172649 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:15.174059 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.231007 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ce64-bd9b-4d6d-abe1-a5328daf30b3 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:15.234651 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:15.235295 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.235585 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.235891 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.245267 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.246690 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.256097 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1415/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:15.521189 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:15.522645 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:15.536381 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c795a09-2b74-45ce-91a5-9ef91adad33e None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:15.541800 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:15.542674 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.542962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.543243 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] PATH_INFO: `/v3/projects/7b0047b467ef4508bba6852e56ecb358` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.544473 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0047b467ef4508bba6852e56ecb358)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.546416 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.578678 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.594875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0047b467ef4508bba6852e56ecb358', 'request_id': 'req-b0f7c8b0-9974-46cf-893f-75393d66647d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.600333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0047b467ef4508bba6852e56ecb358', 'request_id': 'req-b0f7c8b0-9974-46cf-893f-75393d66647d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.606621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0047b467ef4508bba6852e56ecb358', 'request_id': 'req-b0f7c8b0-9974-46cf-893f-75393d66647d'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.620008 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] The token cache is being invalidate because project 7b0047b467ef4508bba6852e56ecb358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:15.620325 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.620945 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.622490 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1466/2881] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:15 2022] DELETE /identity/v3/projects/7b0047b467ef4508bba6852e56ecb358 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:15.626550 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:15.636671 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148cab0-e61d-4f32-8f0a-be7a3af3e892 service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:15.691109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:15.692002 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:15.692294 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:15.692626 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] PATH_INFO: `/v3/users/c8d345505dff4e8eadedc92c69e987f9` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:15.693739 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d345505dff4e8eadedc92c69e987f9)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:15.695648 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:15.742456 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d345505dff4e8eadedc92c69e987f9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.750239 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d345505dff4e8eadedc92c69e987f9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.757567 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d345505dff4e8eadedc92c69e987f9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.758225 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d345505dff4e8eadedc92c69e987f9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.758823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-15f8ea6e-6071-4e9f-926e-407744fbfbec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d345505dff4e8eadedc92c69e987f9'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:15.763356 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.778948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1416/2882] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:15 2022] DELETE /identity/v3/users/c8d345505dff4e8eadedc92c69e987f9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:16.050434 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.051936 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.067152 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c8b0-9974-46cf-893f-75393d66647d admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.125885 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.126740 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.127024 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.127302 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] PATH_INFO: `/v3/projects/445f1dbb020846fea4ca14f72eabcbdd` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.128488 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445f1dbb020846fea4ca14f72eabcbdd)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.130393 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.175845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445f1dbb020846fea4ca14f72eabcbdd', 'request_id': 'req-c4ae3184-0569-4af9-8033-6024a5b76789'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.182108 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445f1dbb020846fea4ca14f72eabcbdd', 'request_id': 'req-c4ae3184-0569-4af9-8033-6024a5b76789'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.188287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445f1dbb020846fea4ca14f72eabcbdd', 'request_id': 'req-c4ae3184-0569-4af9-8033-6024a5b76789'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.200538 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] The token cache is being invalidate because project 445f1dbb020846fea4ca14f72eabcbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:16.200858 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.201486 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-c4ae3184-0569-4af9-8033-6024a5b76789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:16.203047 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1467/2883] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:16 2022] DELETE /identity/v3/projects/445f1dbb020846fea4ca14f72eabcbdd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:16.208948 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.209428 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.209549 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.227837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:16.229141 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.290985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1417/2884] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:16.348657 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.348956 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.349244 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.367516 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:16.369266 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.377116 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1468/2885] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:16.381331 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.391984 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20f3d1-3f38-469f-8913-1254c68a316c None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.396518 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.397169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.397461 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.397741 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.398466 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:16.398777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.400604 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.411935 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1418/2886] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:16.416420 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.425651 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59338947-5ed9-46e9-8a56-2fe241c9497b None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.430257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.430904 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.431195 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.432079 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.432808 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.434720 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.461356 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1469/2887] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:16.465752 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.475542 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b244-4ac0-4e12-bede-8bf93d7ae1c0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.531285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.531992 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.532281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.532562 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.533254 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.535169 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.555200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1419/2888] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:16.559745 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.570312 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad4dd5-9f97-411a-a3f2-cd03b8ceb49a admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.575285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.575991 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.576285 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.576600 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.577333 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.578983 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.589799 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1470/2889] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:16.593686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.604167 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661c2d-0495-456d-9557-53f8bf89f7b0 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.608763 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071ee35-3ee0-465e-866c-575d1a8ce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.609413 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071ee35-3ee0-465e-866c-575d1a8ce269 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.609705 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071ee35-3ee0-465e-866c-575d1a8ce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.609987 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071ee35-3ee0-465e-866c-575d1a8ce269 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.610716 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071ee35-3ee0-465e-866c-575d1a8ce269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.612587 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071ee35-3ee0-465e-866c-575d1a8ce269 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.623166 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1420/2890] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:16.627010 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.636845 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03b54-ddb2-495a-826f-d0f890a95f71 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.641559 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.642477 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.642759 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.643038 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] PATH_INFO: `/v3/projects/1441feb0579b4533a4357c65459b6fbf/users/dcd0779fc04a476791b8082b17e1ce97/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.645361 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:16.659957 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1441feb0579b4533a4357c65459b6fbf, user_id=dcd0779fc04a476791b8082b17e1ce97, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.662632 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.675430 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1471/2891] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:16 2022] PUT /identity/v3/projects/1441feb0579b4533a4357c65459b6fbf/users/dcd0779fc04a476791b8082b17e1ce97/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:16.686683 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.686983 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.687272 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.713345 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] MFA Rules not processed for user `dcd0779fc04a476791b8082b17e1ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:16.714608 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.755312 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:16.780501 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1421/2892] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:16.792545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.794298 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:16.852235 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d539996-c620-47ea-9ab5-f2c12d45f528 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.855989 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401e521-9f61-4329-a5ef-ee44f036051a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.856628 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401e521-9f61-4329-a5ef-ee44f036051a service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.856913 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401e521-9f61-4329-a5ef-ee44f036051a service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.857192 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401e521-9f61-4329-a5ef-ee44f036051a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.865606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401e521-9f61-4329-a5ef-ee44f036051a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.867029 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401e521-9f61-4329-a5ef-ee44f036051a service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:16.876365 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1472/2893] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:16.896133 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:16.957837 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049fcc0-8e3d-440b-9c6d-66ef3f1534fe None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:16.962393 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:16.963285 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:16.963576 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:16.963856 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] PATH_INFO: `/v3/users/dcd0779fc04a476791b8082b17e1ce97` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:16.965080 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd0779fc04a476791b8082b17e1ce97)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:16.966985 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.012962 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd0779fc04a476791b8082b17e1ce97'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.019974 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd0779fc04a476791b8082b17e1ce97'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.027352 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd0779fc04a476791b8082b17e1ce97'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.028051 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd0779fc04a476791b8082b17e1ce97'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.028686 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd0779fc04a476791b8082b17e1ce97'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.045963 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1422/2894] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:16 2022] DELETE /identity/v3/users/dcd0779fc04a476791b8082b17e1ce97 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:17.050417 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.050743 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.051023 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.068658 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:17.069849 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.128138 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1473/2895] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:17.138436 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.139980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.196931 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50555679-a27f-42ee-8253-f5a71ea2b756 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.201076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd653c3-169d-4f77-8d54-e038cd6e846c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.201712 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd653c3-169d-4f77-8d54-e038cd6e846c service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.201999 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd653c3-169d-4f77-8d54-e038cd6e846c service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.202281 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd653c3-169d-4f77-8d54-e038cd6e846c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.210980 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd653c3-169d-4f77-8d54-e038cd6e846c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.212426 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd653c3-169d-4f77-8d54-e038cd6e846c service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.221740 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1423/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:17.485545 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.487455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.502829 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e64787-bf10-4a23-807a-ebc2059eee26 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.507809 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.508717 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.509006 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.509287 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] PATH_INFO: `/v3/projects/1441feb0579b4533a4357c65459b6fbf` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.511561 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1441feb0579b4533a4357c65459b6fbf)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.513656 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.561369 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1441feb0579b4533a4357c65459b6fbf', 'request_id': 'req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.566868 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1441feb0579b4533a4357c65459b6fbf', 'request_id': 'req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.573746 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1441feb0579b4533a4357c65459b6fbf', 'request_id': 'req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.585694 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] The token cache is being invalidate because project 1441feb0579b4533a4357c65459b6fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:17.585986 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.586609 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-b56b9e25-f2b1-4bfc-9fbe-ae5a2ed557b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:17.588875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1474/2897] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:17 2022] DELETE /identity/v3/projects/1441feb0579b4533a4357c65459b6fbf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:17.593862 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.594160 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.594445 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.600734 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:17.614583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:17.615783 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.675364 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1424/2898] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:17.683059 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.683358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.683650 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.703177 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:17.704423 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:17.712331 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1475/2899] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:17.716941 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.726592 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e058a-1a27-43d4-a9f7-252dd7aa0b19 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.732076 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.732742 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.733032 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.733443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] PATH_INFO: `/v3/domains` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.734188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:17.734505 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.736143 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.748354 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1425/2900] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:42:17.752553 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.757054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:17.763233 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5d70-eead-41e9-bfb3-8cd64e3c67b1 None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.768683 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.769336 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.769621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.769903 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.770621 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.772575 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.798043 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1476/2901] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:17 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:17.802156 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.813493 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d321ed6-c2f5-4a36-8968-a38b89f50620 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.872031 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.872694 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.872982 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.873263 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] PATH_INFO: `/v3/users` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.873954 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.875896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.895603 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1426/2902] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:17 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:17.899668 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.910875 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294934f-fd9c-47ec-abc7-aec1c1b68c42 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.915455 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.916703 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.916990 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.917269 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.917997 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.919612 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.929895 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1477/2903] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:17.934764 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.944711 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4a227-0e64-42ed-92c3-b958847b9425 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.950198 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378f76-8705-4224-9374-ec8003f134c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.950845 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378f76-8705-4224-9374-ec8003f134c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.951134 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378f76-8705-4224-9374-ec8003f134c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.951434 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378f76-8705-4224-9374-ec8003f134c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.952190 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378f76-8705-4224-9374-ec8003f134c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:17.953780 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378f76-8705-4224-9374-ec8003f134c3 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:17.964866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1427/2904] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:17.968909 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:17.979137 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00a5c4-d752-46ba-8d51-4c9c66f045cf admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:17.983384 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:17.984295 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:17.984579 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:17.984856 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] PATH_INFO: `/v3/projects/d18663eda5b04d64b24564f239e7fcfa/users/03742184321d426c8c6d319084a0cb36/roles/0eee518727f846bfb1fccbec6af83ca5` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:17.999257 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18663eda5b04d64b24564f239e7fcfa, user_id=03742184321d426c8c6d319084a0cb36, role_id=0eee518727f846bfb1fccbec6af83ca5)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:18.001918 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:18.015896 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1478/2905] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:17 2022] PUT /identity/v3/projects/d18663eda5b04d64b24564f239e7fcfa/users/03742184321d426c8c6d319084a0cb36/roles/0eee518727f846bfb1fccbec6af83ca5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:18.027582 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] REQUEST_METHOD: `POST` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:18.027897 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:18.028188 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:18.054896 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.auth.core [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] MFA Rules not processed for user `03742184321d426c8c6d319084a0cb36`. Rule list: `[]` (Enabled: `True`). {{(pid=86571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:18.056245 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:18.117830 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:18.125433 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1428/2906] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:18.135662 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:18.137408 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:18.200310 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3cc04-bf9e-4f2e-b66b-9995c934fc00 admin admin] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:18.203962 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5948fcc-7e38-4b91-a7f3-d561cc707220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '367573878e1d440594736c21e9a5497b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:18.204606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5948fcc-7e38-4b91-a7f3-d561cc707220 service cinder] REQUEST_METHOD: `GET` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:18.204894 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5948fcc-7e38-4b91-a7f3-d561cc707220 service cinder] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:18.205176 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5948fcc-7e38-4b91-a7f3-d561cc707220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:18.213492 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5948fcc-7e38-4b91-a7f3-d561cc707220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:18.214922 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5948fcc-7e38-4b91-a7f3-d561cc707220 service cinder] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:18.223649 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1479/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:27.971823 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:28.033200 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e8d9d-f9e2-4279-9a4d-3f5050a00f50 None None] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:28.037678 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:28.038540 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:28.038825 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:28.039109 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] PATH_INFO: `/v3/users/03742184321d426c8c6d319084a0cb36` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:28.040300 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03742184321d426c8c6d319084a0cb36)` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:28.042789 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:28.092244 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03742184321d426c8c6d319084a0cb36'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.099667 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03742184321d426c8c6d319084a0cb36'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.107516 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03742184321d426c8c6d319084a0cb36'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.108173 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03742184321d426c8c6d319084a0cb36'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.108777 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.notifications [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03742184321d426c8c6d319084a0cb36'} {{(pid=86571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.126023 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1429/2908] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:27 2022] DELETE /identity/v3/users/03742184321d426c8c6d319084a0cb36 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:28.130606 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] REQUEST_METHOD: `POST` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:28.131111 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:28.131218 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:28.148976 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.auth.core [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] MFA Rules not processed for user `725291ff274c49f98fe318d9ba9e0802`. Rule list: `[]` (Enabled: `True`). {{(pid=86570) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:28.150696 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:28.207994 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1480/2909] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 16 00:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:28.217571 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:28.218905 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:28.276130 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e3501-1609-4a1a-a768-6ad762e34792 admin admin] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:28.279765 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb15a3e003fb4f0f8f876c5635b6a020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:28.280443 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:28.280766 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:28.281050 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:28.290102 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:28.292139 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:28.303530 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1430/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:28.569335 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] Authenticating user token {{(pid=86570) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:28.570782 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.fernet_utils [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86570) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:28.583817 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cff0f-6a21-4b23-b8d6-a67e0d3a1e8c None None] Validating token access rules against request {{(pid=86570) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:28.588891 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '725291ff274c49f98fe318d9ba9e0802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd17e5ca3e11d4286858e2160767efdde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86570) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:28.589761 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:28.590054 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] SCRIPT_NAME: `/identity` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:28.590370 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] PATH_INFO: `/v3/projects/d18663eda5b04d64b24564f239e7fcfa` {{(pid=86570) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:28.591591 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18663eda5b04d64b24564f239e7fcfa)` {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:28.593706 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] RBAC: Authorization granted {{(pid=86570) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:28.637438 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:28.641479 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18663eda5b04d64b24564f239e7fcfa', 'request_id': 'req-9113b193-b06f-444a-b1e1-71562a58884a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.648397 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18663eda5b04d64b24564f239e7fcfa', 'request_id': 'req-9113b193-b06f-444a-b1e1-71562a58884a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.654727 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18663eda5b04d64b24564f239e7fcfa', 'request_id': 'req-9113b193-b06f-444a-b1e1-71562a58884a'} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.667067 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] The token cache is being invalidate because project d18663eda5b04d64b24564f239e7fcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86570) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:28.667358 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.668049 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG keystone.notifications [None req-9113b193-b06f-444a-b1e1-71562a58884a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86570) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:28.669597 dv-cinder-843277-4-smb devstack@keystone.service[86570]: [pid: 86570|app: 0|req: 1481/2911] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:28 2022] DELETE /identity/v3/projects/d18663eda5b04d64b24564f239e7fcfa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:38.299194 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:38.663456 dv-cinder-843277-4-smb devstack@keystone.service[86570]: DEBUG dbcounter [-] [86570] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:48.639212 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] Authenticating user token {{(pid=86571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:48.640676 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:48.710105 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c48935-1dd0-4458-8971-b962fa1e5b4c service neutron] Validating token access rules against request {{(pid=86571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:48.770637 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832a04959b5448738fb9d46cf42845a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c36fde2902e4433f992944525dfd2b56', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:48.771293 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] REQUEST_METHOD: `GET` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:48.771583 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] SCRIPT_NAME: `/identity` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:48.771866 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:48.773680 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.fernet_utils [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:48.784972 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:48.786555 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd49683-7873-4706-9b6b-6714d753caa6 service placement] RBAC: Authorization granted {{(pid=86571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:48.796960 dv-cinder-843277-4-smb devstack@keystone.service[86571]: [pid: 86571|app: 0|req: 1431/2912] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:58.792132 dv-cinder-843277-4-smb devstack@keystone.service[86571]: DEBUG dbcounter [-] [86571] Writing DB stats keystone:SELECT=58 {{(pid=86571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}